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ABSTRACT 


The purpose of this thesis is to investigate the effects of graduate education on the 
job performance of Department of Defense (DoD) civilian employees. The data used in 
this thesis were drawn from the Department of Defense Civilian Personnel Data File, 
which was provided by the Defense Manpower Data Center. The raw data were restricted 
to employees who possess at least a Bachelor's degree and are paid under General 
Schedule (GS) or General Management (GM) pay systems. Four performance measures 
were developed to investigate the effect of graduate education on job performance: salary 
level, promotion, retention, and performance rating. Four multivariate models were 
constructed for these performance measures. Ordinary least square (OLS) techniques 
were used to estimate the salary model. Logistic regression was used to estimate the 
promotion, retention, and performance rating models. The results found that the effect of 
having a Master's degree was positive in the salary, promotion, and performance ratings 
models. The effect of a Master’s was negative in the retention model. All these findings 
were consistent with basic human capital investment theory. The thesis recommends that 
future research develop alternative job performance indicators and focus on specific 


occupations and functional areas. 
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{i INTRODUCTION 


. BACKGROUND 

This study examines the effects of graduate education on the job peroriiance of 
Department of Defense (DoD) civilian employees. Human capital investment theory 
suggests that an individual's productivity, and therefore his/her earnings, increases with 
additional education. As with other types of investments, an investment in human capital 
entails costs that are borne in the near term with the expectation that benefits will accrue | 
in the future. In the case of educational and training investments by individuals, the 
expected returns are in the form of higher future earnings and increased job satisfaction 


over one's lifetime. 


The basic human capital investment model assumes that people are utility 
maximizers and take a lifetime perspective when making choices about education and 
training. For this reason, individuals are assumed to compare the near-term investment 
costs with the present value of expected future benefits when making a decision about 
additional schooling. Investment in additional schooling is attractive if the present value 
of future benefits exceeds costs. Utility maximization requires that people continue to 
make additional investments in human capital as long as benefits exceed costs and to 
oo wily when the (marginal) benefits of additional pi yeanneats are equal to or less than 
the additional (marginal) costs. In the case of graduate education, an individual invests in 
such a program expecting higher future earnings, promotion to higher levels in the 


organization in which he/she works, or other pecuniary and non-pecuniary benefits. 








According to human capital theory, we can classify education/training into two 
categories: general and firm specific. General sivinatinnttedietis increases an individual's 
productivity to any number of potential employers at the same time. On the other hand, . 
firm-specific education increases an individual's productivity in the current employer/ — 
organization but not in other firms. One difference between the two types of training is in 
ie pays for the training. Because general training is easily transferred to other firms, the 
employee’s firm has no elias to pay for this type of training. If the firm provides 
general training then the individual pays for the training through lower wages so the firm 
can recoup the cost of the training. Specific training is paid for by the firm, or by both the 


individual and the firm. 


So far, the effects of post-secondary saucdien on earnings have been studied 
extensively, But few researchers have investi gated the effect on individual workers 
within a firm or organization. For example, David A.Wise conducted two studies in 1975 
and concluded that graduate education provided a positive increase on salary for the 
employees of a single firm. Studies that have observed this effect have attributed the 
higher earnings to better job performance. On the other hand, James Medoff and. 
Katharine Abraham (1980) found a positive association between experience anid relative 
earnings within grade levels in three U.S. manufacturing corporations. They found that 
oe a Master's degree had a positive effect on earnings but when grade level was 
controlled this effect decreased significantly. However, they found either no association, 
or a negative association, between ecdence and rated performance (a proxy for 


productivity). They suggest that these findings provide evidence contrary to implications 











of human capital theories that the higher earnings of more experienced workers in a firm 
reflect their on-the-job training, which makes them more productive than their less ~ 
experienced peers. B. Dunson (1985) replicated one of the Medofi-Abraham tests to 
examine whether aeencess in earnings for a selected group of ssilian middle managers 
and professionals i in the DoD can be explained by the hypothesis that more experienced 
workers are more productive workers. His results were similar to those of Medoff and 
Abraham. He also found that graduate education had a positive effect on earnings, but 
this effect decreased significantly, as in Medoff - Abraham study, when grade level was 


controlled. The data set used by B. Dunson is the same one used in this study. 


Mehay and Bowman (1999) seamed the effect of graduate education on the job 
performance of Navy officers. They used promotion as a performance measure and found — 
that those with graduate degrees were more likely to be promoted. The effect was 
somewhat larger for those with degrees funded by the Navy. iia the effects of 
graduate degrees were smaller in models that adjusted for selection bias. These results 
contradict, to some extent, those in Medoff — Abraham and Dunson. Thus, there is some 
controversy as to whether graduate education actually improves a worker’s on-the-job 
performance or whether such degrees merely signal desirable attributes to potential 


employers. 


In this research, we investigate the effect of graduate education on the job 
performance of DoD civilian employees and attempt to determine whether the link 
between advanced degrees and job performance is causal in nature. The research relies on 


measures of promotion and performance within a single large organization. 


B. PURPOSE OF THE THESIS 


The purpose of this research is to explore the impact of various background, 
experience, and demographic factors, with specific emphasis on graduate education, on 
the job performance of DoD civilian employees. The mi requires reviewing the 
nature of the federal civilian personnel system including pay, promotion and performance 
appraisal. This review will assist us in developing measures of productivity and - 


constructing multivariate models to explore the determinants of on-the-job performance. 


The data used in this thesis were drawn from Department of Defense Civilian 
Personnel Data Files, which were provided by Defense Manpower Data Center (DMDC). 
Two data files exist for DoD civilian personnel: (1) an inventory (current status) file, and 
(2) a transaction (dynamic) file. Both files contain similar data elements. For the purpose 
of this study, the DMDC aieceed these two files. These files cover personnel paid from 
appropriated funds in all Defense agencies except the National Security Agency, the 
National Imagery and Mapping Agency, and the Defense Intelligence Agency. They also 
exclude coverage of foreign national direct saa indirect hire civilian employees outside 
the 50 states and the District of Colombia. However, the raw data used in this thesis were 
restricted to employees who possess at least a Bachelor's degree and are paid under 


General Schedule (GS) or General Management (GM) pay systems. 


The primary research question for this thesis is: "What is the effect of graduate 
education on the job performance of DoD civilian employees?” A secondary question is: 


“What is the payoff to employees and the DoD of advanced education?" To be able to 


answer these questions different performance measures such as salary level, promotion, 
performance ratings, differential between consecutive salaries, time elapsed between 
consecutive promotions, and retention should be investigated. In this thesis, we analyze 
four of these iiaiainin aceciiee salary onal promotion, perience ratings, and 


retention. 


C. ORGANIZATION OF THE THESIS 


This thesis is organized into six chapters. Chapter II gives summary information 
about the DoD civilian workforce. After providing general information and discussing 
summary statistics, the chapter reviews the performance management, promotion, and 
‘pay systems that apply to DoD civilians. It provides important information necessary for 
understanding DoD's pay, promotion and performance appraisal syatitig and for 

~ specifying the statistical models of this thesis. ‘Chinas III provides a brief review of 
human capital theory. It also reviews six past research efforts on the payoff to graduate 


education. Chapter IV describes the data set used in this study and explains the 





‘methodology for constructing multivariate performance models used to measure the 
effects of graduate education on job performance. It also provides descriptive statistics 
about each sample used in the models. Chapter V presents the results of the multivariate 
analyses for four different performance models specified in Chapter IV. Chapter VI 
summarizes the results, provides conclusions about the returns of graduate education and 


makes recommendations for further areas of research. 
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Il. BACKGROUND 


This chapter provides general background information and statistics about the DoD 
civilian workforce. It also reviews the performance management, promotion, and pay 
systems that apply to DoD civilians. This information is necessary for understanding DoD’s 


pay and promotion systems and the statistical models specified in Chapter IV. 


A. GENERAL | 


The Department of Defense (DoD) civilian workforce is a crucial link in the 
United States’ national defense. The DoD employs more than 800,000 civilians around 
the world and, even with the drawdown, it remains by far the federal agency with the 
largest number of employees. Civilians comprise about sne-tourt of the all DoD 
personnel. They develop and maintain sophisticated systems, sihaee complex programs, 
handle the day-to-day business of feeding, housing and paying personnel, and sometimes 
go in harm's way to support uniformed. military forces. [Ref. 2] For purposes of this 
thesis, we will define the DoD civilian workforce as those in the continental U.S. 
excluding the National Security Agency, the National ined and Mapping Agency, and 
the Defense Intelligence Agency. Table 2.1 provides total civilian personnel strength by 
agency for FY1986 through FY 1998, The table indicates that the DoD civilian workforce 


has fallen over 30 percent since 1986 as a result of the defense downsizing. 





Table 2.1. DoD Direct Hire Civilian Personnel Strength Level by Agency 


(Fiscal Years 1986-1998) 















FY Total 
1986] 389,960] 335,651 | 252,127 90,236) 1,067,974 
2 
i988] 372,619] 341.655 24S TO] 92,235] 1,008. 
582,74 
oI 
[  785,303[ 255.657] 169.588 148 330] 870 TE 
[273.231[ 256,067] 180,148 140,560] 85,806 













1993 
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1998} 239,187 196,697 166,096 115,921 717,901 


Source : From Ref. [ 1] 






DoD's civilians are highly talented and well educated. Table 2.2 shows that, as of 


February 1999, nearly 70,000 (or 10 percent) hold advanced degrees, and over 210,000 


_ (over 30 percent) have at least a Bachelor's degree. Civilian workers are engaged in a 


variety of jobs: scientists, engineers, logisticians, accountants and budget analysts, 


purchasing agents, computer specialists, linguists, human resource managers, lawyers, 
physicians and nurses, veterinarians, and equal opportunity specialists. While 25 percent 
of DoD civilian workers hold blue-collar jobs, 75 percent hold professional, technical, 


administrative, and clerical positions. The percentage of white-collar workers in DoD is 


considerably higher than the percentage in the overall civilian workforce in the US., 


which was 58.6 percent in 1997 [Ref. 3: pp. 417-419]. 











Table 2.2. Distribution of DoD Civilian Employees by Educational Attainment and 


Agency (February 1999). ; 


150,826} 67.4 65.8) 114,310] 71.8) 73,947) 66.2 


7 

| HS+ | 6 | 
Y 22,458] 10.0| _17,304| 9.1 _15,409[ 9.7] _ 12,764] 10.2] 67,935} 

| Total | 223,741/ 100] 189,496] 100] 159,13 100 

Source: After Ref. [4] 





The DoD hires nearly 20,000 new civilian employees every year in a variety of 
occupations all over the world. Tables 2.3 and 2.4 show that DoD is the nation's largest 
employer of women and minorities. DoD's civilian workforce consists of 258,289 women 
(37 percent of all employees), 97,349 African Americans (14 percent), and 42,765 
Hispanics (6 percent). The DoD has been ; model of diveniiy for other needcies and 
institutions, providing opportunities without regard to race or gender. The DoD also 
invests in a variety of computer technologies to accommodate individuals with 
disabilities. Despite a significant downsizing, the DoD has been able to retain its diverse 
workforce. Personnel cuts in the 1990's have affected men and women in equal 
proportions. In 1999 female employees comprise 37.6 percent of the workforce, the same 
proportion they did in September 1989 before the beginning of the defense downsizing. 
At the same time, the DoD has made progress in increasing cepreeeiellion of women and 
minorities in its higher graded positions. In grades GS-13 (general schiile) through SES 
(senior executive service), the proportion of women has increased from 14 to 19 percent. 


The proportion of minority group members has also increased from 10 to 12 percent in 


the same grades. In response to major changes in the nation's defense needs, the DoD is 
reshaping the total force. But it is ever mindful of the continuing need to recruit, train and 
retain high quality people. [Ref. 2] 


Table 2.3. Distribution of DoD Civilian Employees by Gender and Agency 
a (February 1999) 








[Army [Navy | AirForee | Other DoD | Total 
Female | 83,952| 37.5| _ 60,975| 32.2| _ 52,132] 32.8| 61,230] 53.6| 258,289] 37.6 
Total | 223,741 100] 189,496] 100] 159,138] 100] 114,225] 100] 686,600] 100 


Source: After Ref. [4] 







Table 2.4. Distribution of DoD Civilian Employees by Race and Agency 


(February 1999) 


“25,166 13.3] 16,496] 10.4] 21,587] 18.9] _ 97,349] 142] 


Black | ,166| 13.3 

Hispanic | 13-460, 6.0L 8 300[ 44] 15,0231 9a) 3.983 
| ,335| 10.7 
| 6 













Other | _11,378| 5.1] 20,335] 10.7] 6,774] 43] 6,676] 5.8] 43,163] 6.6 
Total | 223,741| 100] 189,496] 100 159,138] 100] 114,225] 100] 686,600] 100 


Source: After Ref. [4] 
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B. PERFORMANCE MANAGEMENT 


According to the DoD Directive 1400.25 on "Civilian Personnel Management 
System," [Ref.5] the objective of performance management is to improve individual, 
team (where applicable), and organizational performance. An integral part of this 


objective is the establishment of management accountability for Equal Employment 


10 








Opportunity (EEO) and Affirmative Employment Program (AEP) practices and 


principles. According to the Directive, in achieving this objective, performance 


_ Imanagement programs should: 


1. 


be designed to meet and integrate fully into organizational or mission goals and 
objectives, and management processes; 


be designed and used as tools for executing management and supervisory 
responsibilities; communicating and a organizational goals and 
objectives to employees; 


identify employee, team, and managerial accountability for the accomplishment 
of individual, team and organizational goals and objectives; 


provide for planning, monitoring, developing, and evaluating individual, team, 
and organizational performance; use appropriate measures of performance to 
recognize and reward employees; and use the results of performance appraisal as 
a basis for appropriate personnel actions; | 


support and be consistent with merit system principles in the United States Code. 


[Ref. 5] 


Performance Appraisal System 


The DoD Performance Appraisal System governs all performance appraisal 


programs for covered employees within the DoD [Ref. 5]. It establishes performance 


appraisal program requirements and it complies with Federal regulations (United States 


Code, Code for Federal Regulations) and other applicable laws and regulations. 


Federal employees are subject to periodic appraisals of their job performance 


under Performance Management Regulations issued by the Office of Personnel 


I] 





Management (OPM). These performance appraisal procedures can have an impact on a 
wide variety of personnel and employment decisions affecting federal workers. Under the 
performance management rules, agencies must establish performance appraisal systems 


that: 


@ provide for periodic appraisals of job performance; 
® encourage employee participation in establishing performance standards; and 


_@ use appraisal results as a basis for personnel actions affecting employees. [Ref.6] 
The performance appraisal systems set up and used by agencies also must be 


designed to accomplish the following: 


e establish performance standards that will permit accurate evaluations of job 
performance on the basis of objective criteria related to the job; 


® communicate to each employee the performance standards and critical elements 
of the employee's position with respect to initial appraisal periods, and thereafter 
at the beginning of each following appraisal period; 


@ evaluate each employee on such standards during the appraisal period; 
@ recognize and reward employees whose performance so warrants; 
@ assist employees in improving unacceptable performance; and 


@ reassign, demote, or remove employees who continue to have less than 
acceptable performance, but only after such workers are given an opportunity to 
demonstrate acceptable performance. [Ref. 6] 








The appraisal systems ied be based on objective, job-related criteria and 
performance standards must be developed for each element of. the job on which an 
employee is to be evaluated. Performance standards are the | expressed measure of the | 
level of | sihuneiais established by mieaasenent for duties and seesoneibilitics of a 
position or group of positions. Performance standards may include, but are not limited to, 
elements such as quantity, quality, timeliness, and manner of performance. Agencies are 
encouraged to have employees participate in establishing their standards. Each 
department and agency sets up its own performance appraisal system based on OPM's 


general regulations. [Ref. 6: p. 231] 


2. Summary Level 


Each performance appraisal program must provide a method for aban and 
assigning a summary weioumance level from one, and only one, of the following 
patterns. These patterns, shown in Table 2.5, are based on appraisal of performance on 
critical elements and, where applicable, non-critical elements. In Table 2.5, Level 1 
trench Level 5 are ordered categories, with Level 1 as the lowest and Level 5 as the 
highest: Level 1 is "Unacceptable"; Level 3 is "Fully Successful" or the equivalent; and 
Level 5 is "Outstanding" or the equivalent as of 1996.) These patterns give flexibility to 


the agencies to set their own appraisal systems. 


' Before FY 1996 the ordering of the rating levels was reverse (e.g., 1-outstanding, and 5- unacceptable). 
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Table 2.5. Patterns of Summary Performance Levels 
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Source: From Ref. [5] 


For example, the Department of the Navy (DoN) currently uses a two-level rating 
program, which appraise an employee’s performance as being at either an “Acceptable” 


or “Unacceptable” level (Pattern A). 


C. MERIT PROMOTION SYSTEM 


If someone is a career or sarees -opndiabnel employee in the competitive civil 
service, he/she is covered by the Federal Merit Promotion Policy. A ase appointment 
confers permanent status and cated appointees have the greatest possible job protection. 
A person selected for a continuing position in the federal service is given a career 
conditional appointment. The first year of service under a career-conditional appointment 
is a probationary period after which they may be converted to a permanent appointment. 
The purpose of the Federal Merit Promotion Policy is to ensure the selection of the best- 


qualified candidates to open positions. It provides for promotions to be made fairly, and 








é 


for promotion practices that will support an agency's efforts to select the best qualified 


persons in any given instance. [Ref. 7: p. 159] | —_ 


_.. As an agency subject to Performance Management Regulations issued by the 
Office of Personnel Management (OPM), the DoD may promote, demnte, or reassign , 
career or career-conditional employee because responsibility for the operation of merit 
promotion programs rests with individual agencies. Each agency is required to have a 
merit sigiieGbh plan which conforms to OPM requirements and details og promotions 


are made in the agency. 


A promotion is a change to a higher grade and should not be confused with 


periodic "within-grade increases" or "quality step-increases," which provide salary 


‘increases within the scheduled rates of the grade. Opportunities for advancement or 


promotions often occur when new positions are established because of reorganization, 
when program responsibilities are added, or when an employee vacates a position. 
Competition among employees is generally required. To be eligible for promotion 
employees generally must meet the position'’s qualification requirements and,. if 
applicable, time-in-grade requirements, the time-after-competitive-appointment 


restriction, and requirements for fully successful performance. [Ref. 6: p. 230] 


Merit promotion programs must conform to the following requirements: 


e Each agency must establish procedures for promoting employees that are based 
on merit and are available in writing to candidates. Actions under a promotion 
plan - whether identification, qualification, evaluation, or selection of candidates 
- must be made without regard to political, religious, or labor organization 
affiliation or non-affiliation, marital status, race, color, sex, national origin, non- 
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disqualifying physical handicap, or age, and must be based solely on job-related 
criteria; 


e Areas of consideration must be sufficiently broad to ensure the availability of 
high quality candidates, aaeoe into account the nature and level of _— | 
covered; | 


e To be eligible for promotion or placement, candidates must meet the minimum 
qualification standards; 


e@ Selection procedures will provide for management's right to select or not select 
from among a group of best qualified candidates. They will also provide for 
management's right to select from other appropriate sources, such as 
employment priority lists, reinstatement, transfer, handicapped, or Veteran 
Readjustment Act eligibles; 


e Administration of the promotion system will include record keeping and the 
provision of necessary information to employees and the public, ensuring that 
individuals' rights to privacy are protected. A temporary record of each 
promotion must be maintained to allow reconstruction of the promotion action, — 
including documentation on how candidates were rated and ranked. [Ref. 8] 


No employee must receive a promotion unless his or her current rating of record 
1S "Fully Successful" (level 3) or higher. In addition, no employee may receive a career 
ladder promotion who has a rating below "Fully Successful” on a critical element that is 
also critical to performance at the next higher grade of the career ladder. [Ref. 8: pp. 226- 


229] 


D. PAY RATES AND SYSTEMS 


There are various pay systems used by the federal government that are also 


applicable to the DoD civilian workforce. Most federal employees are paid under one of 














the two main government pay systems: (1) the "general schedule" (GS) pay system, 
which sets specific salary levels for federal white-collar workers, or (2) the wage system, 
which pertains to the government's craft and trade (blue-collar) workers. Both GS and 
wage system (WS) rates are established and adjusted annually pursuant to law and 
implementing regulations. In addition, there are a number of other pay schedules and 
salary systems that govern the amount of compensation paid to certain groups of 
government employees. Separate pay-setting procedures are in place, for example, for 
congressional and judicial employees, as well as Executive Level, Senior Executive 
Service, Senior Level, scientific professional, administrative law judges, certain medical 
personnel, and other government workers [Ref. 6: p. 7]. Within the Department of 
Defense, the Civilian Personnel Management Service, Wage-Setting Division, is 
designated the lead agency for coordinating pay issues for the DoD civilian workforce 
[Ref. 5]. Table 2.6 displays the distribution of civilian employees by pay plan and agency 
in 1999. Note that in line with the technical and professional nature of the DoD 
workforce, over two-thirds of all employees are in the GS pay system. 
Table 2.6. Distribution of DoD Civilian Employees by Pay Plan and Agency- 
: ' (February 1999) 4 

ay [Army | Navy | AirForce | Other DoD 
|GS~ [162,559] 72.7| 123,850] 65.4] 103,749] 65.2] 82,941 473,099] 68.9 
43,593| 19.5] 38,943| 20.5] 50,446] 31.7| 15,479| 15.1] 148,461 
Other | = 17,589} 7.8] 26,703] 14.1 4,943} 3.1} 15,805] 11.1{ 65,040] 9.4] 
223,741| 100] 189,496] 100] 159,138} 100] 114,225! 100] 686,600| 100 


Source: After Ref. [4] 
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1. General Schedule (GS) 


The general schedule is the main Bay system that sets the pay rates for employees 
in most "white-collar" positions. The GS pay system covers more than two-thirds of the 

federal workforce. Basically: the seneral schedule is composed of 15 grades, or salary 
| levels. Each grade includes ten steps through which employees advance based on 
satisfactory job performance and length of service. For all GS grades, waiting periods to 
be advanced to each higher step (i.e., qualifying for a "within-grade increase") are ~ _ 
follows: 52 calendar weeks to be advanced to steps 2,.3, and 4; 104 calendar weeks to be 
advanced to steps 5, 6, iad 7; and 156 calendar weeks to be advanced to steps 8, 9, and 


10. 


In most cases, a GS employee's base pay reflects the pay rate specified for the 
position's | grade and step in the locality where the worker is employed. Supervisors of | 
other GS employees ordinarily are dinedted at least one grade higher than those 
employees. However, this does not necessarily mean that supervisors will be paid more 
than each of their subordinates will. The salaries of GS employees are fixed by law. [Ref. 


6: p. 8] 


2. Wage System (WS) 


In contrast to the GS pay rates, the pay of the federal government's wage system 
employees (blue-collar) is fixed as an hourly rate by the lead agencies in accordance with 


the procedures established under Title 5 of The United States Code. Pay rates for wage 
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system employees are set as an hourly rate, and are legally required to be adjusted from 
time to time consistent with the public interest in accordance with prevailing rates. The 
most common wage system schedule, the wage grade (WG) schedule used for most non- 
supervisory workers soniatns 15 grades. Each of the grades ‘chads 5 steps, which a 


set at four percent increments. 


The wage sail prevailing rate determinations are made ai the basis of 
surveys of rates paid by private employers in each local wage area for work similar to 
that performed by federal wage employees. Wage schedules are adjusted at different 
times of the year according to when a lead agency conducts the annual wage survey in 


each individual wage area. [Ref. 6: p. 8] 


THIS PAGE INTENTIONALLY LEFT BLANK. 
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Wl. LITERATURE REVIEW 


This chapter provides a brief review of human capital theory. It also reviews six 
past research efforts on the payoff to graduate education. These consist of two studies of ~ 
Wise (1975), a studies of J. Medoff atid K. Abraham (1980: 1981), one of Bruce 
Dunson (1985), and one of S. Mehay and W. Bowman (1999). This review is important 
for understanding eilier attempts to analyze the effect of education on worker 


performance, and for specifying the econometric models in this thesis. 


A. HUMAN CAPITAL THEORY 


As with other types of investments, an investment in human capital entails costs 
that are borne in the near term with the expectation that benefits will accrue in the future. 
Generally speaking, the costs to the individual of adding to one's human capital through 


education and training programs can be divided into three categories: 


® Out-of-pocket or direct expenses include tuition costs and expenditures on books 
and other supplies; 


e Foregone earnings are another cost, because during the investment period it is 
usually impossible to work, at least full-time; 


'@ Psychic losses are a third kind of cost incurred, because learning is often difficult 
and tedious. . 3 


In the case of educational and training investments by individuals, the expected returns 
are in the form of higher future earnings and increased job satisfaction over one's 


lifetime. 
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The basic human capital investment model assumes that people are utility 
maximizers and take a lifetime perspective when making choices about education and 
training. For this reason, individuals are assumed to compare the near-term investment | 
costs (C) with the present wie of expected Fie benefits when making a degen about 
additional schooling. fisvestinent in additional schooling is attractive if the present value 
of future benefits (B) exceeds costs: | 


B, B, B; 
op nt 1 
It+r (+r)? 


where r is the interest (discount) rate. Utility maximization requires that people continue 
to make additional investments in human capital as long as the above condition is met 
and to stop only when the (marginal) benefits of additional investments are equal to or 


less than the additional (marginal) costs [Ref. 9: p. 289]. 


In the case of graduate education, an individual invests in such a program 
expecting higher future earnings, promotion to higher levels in the organization in which 
s/he works, or other pecuniary and non-pecuniary beneate: We can show potential 
alternative earnings streams with or without graduate education as in Figure 3.1, which 
compares the age-earnings profile for a Master’s degree to that of the next best 


alternative, a Bachelor’s degree only. 


According to human capital theory, we can classify education/training into two 
categories: general and firm specific [Ref. 10]. General education/training increases an- 


individual's productivity to any number of potential employers at the same time. A 
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os 


Master's in Business Administration (MBA) is a good example of general education. On 


the other hand, firm-specific education increases an individual's productivity for the 
current employer/organization but not in other firms. An example would be training in a 


specific firm’s accounting or computer system. 


M.A. Degree . 


Earnings } v 
(dollars) 







Gross Benefits 


A 


B.A. Degree 







Forgone 
Earnings 


Direct 
Costs 


‘Figure 3.1 Alternative Earnings Streams 





The difference between the two types of training is in who pays for the training. 
' Because general training is easily transferred to another firm, the firm has no incentive to 
pay for this type of training. If the firm provides general training then the individual pays 
for the training through lower wages so the firm can recoup the cost of the training. 
Specific training is paid for by both the individual and the firm. The firm will pay the 
individual a wage equal to its competitors during the training period because specific © 


_ training does not provide the individual with skills that would be marketable at another 
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- firm. However, after the training period the firm will be compelled to increase the wage 


to reduce the incentive for the individual to quit. [Ref. 9: pp. 160-61] 


_B. ~ PREVIOUS STUDIES ON GRADUATE EDUCATION 


The effects of graduate education on individual job performance have not been 
investigated directly except in one study by Bowman and Mehay. However, other studies 
have explored the relationship between human capital and earnings or between 
experience and earnings and have included the effects of graduate education. Studies on 
returns to investment in human capital have revealed clearly that more educated people 
earn more than those with less education. Some researchers argue that the positive 
relationship arises because educational attainment enhances an individual's on-the-job 
performance (productivity), which leads to high levels of earning. Others disagree with 
this Sieleasiileds showing stilt that, even though hiinan capital aad earings are 
positively correlated, there is no positive correlation between human capital and 


measured job performance. 


In 1975, David A. Wise conducted two studies = the relationship between 
personal attributes, academic achievement ai job performance [Ref. 11; 12), He 
specifically investigated the correlation between academic achievement and job 
performance using data on individuals worina in a large U.S. adidbiaeiied firm 
characterized by a hierarchical structure. The data were restricted to 1,300 white, male, 
college graduates with different levels of academic achievement. The sample was based 


on technical and non-technical personnel who worked in a particular environment and 
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performed similar tasks and who were no older than 30 years old when hired. Age was 


used to compute pre-firm experience, which was assumed to have a substantial effect on 
individual job performance. The data were augmented by academic and non-academic 
| adil attributes such as socioeconomic pacer high schoo! and college non- 
academic activities, tastes for job security, academic performance, college attended, 


Master’s degree, rank in graduate school class, and employment goals. 


Wise chose salary and probability of promotion, respectively, in his two studies as | 
measures of job performance, based on the assumption that differences in individual job 
performance are reflected in measures of success within the firm. He then used OLS 
techniques to estimate a salary regression model, and maximum likelihood techniques 
(logit) to estimate a promotion model. In both studies, he used the same explanatory 


| variables. - 


The coefficient estimates obtained from both studies had the same signs and 
comparable magnitudes. But calculated promotion probabilities oieiiel a somewhat 
larger effect of abisinige a anstees degree, even with low class rank of achievement, 
than was implied by rate of salary increase figures. The salary model not only shewed 
that academic achievement is a significant determinant of job performance but also that 

mastery of academic subject — contributed to an individual's ability to perform job- 
related tasks. On one hand, according to his salary model, sepia a Master’s a 
has almost no effect on an individual's rate of salary increase, unless he/she graduates at 
least in the top third of his class. On the other hand, the results suggested a considerably 


larger effect of the Master's degree on earnings for engineering or science majors than for 
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business administration majors. Wise's promotion model, however, yielded consistent 
results. Promotion was found to increase with college selectivity, £ollege GPA, and class 

rank 1 in graduate school. Wise also pune that non-academic (“affective”) attributes such 
as lcaitaniis ability, imaginative thinking, expression of one's ideas and desire for job 


security were as significant as academic abilities in determining job performance. 


‘The results that Wise obtained were not inconsistent with the possibility that 
education does nothing to enhance productive ability, but ‘ite only serves a screening 
purpose. However, he suggested that his measures of educational achievement are not 
only related to job performance, but also that the knowledge gained in the educational 


process actually contributed to productive ability. 


In contrast to Wise, James L. Medoff and Katherine G. Abraham provided 


evidence that there was no positive correlation between "human capital” and "job 


performance” in two studies [Ref. 13; 14]. In both studies, they examined the causal - 


relation between experience, performance and earnings among managerial and 
professional employees. For their first study, they ised data drawn from the personnel 
records of two ieee corporations in the U.S. manufacturing sector. The corporations 
provided computerized personnel coats for virtually all the members of their exempt 
workforce. For the analysis data were restricted to white, male, active, full time, regular, 
domestically aged employees. The final data set consisted of the employees in jobs 
categorized as managerial or professional under the Equal Employment Opportunity 
Commission's job classification scheme. The data contained information on each 


employee's education, birth date, service date, current physical work location, most recent 
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performance ratings, and current salary. The schooling information was used to 


categorize individuals by highest level of educational attainment: less than high school, 


high school diploma, bachelor’s degree, master's or law degree, or doctorate. 


Medoff and Median first specified a sinned semi-log salary model where the 
independent variables were highest level of educational attainment, pre-company | 
experience, company service, performance ratings, grade level dummies, and region 
dummies. They ran the model three times introducing grade level dummies in the second 
run and performance ratings in the third. Table 3. 1 shows their basic results. Estimations 
obtained from the first model (column 1, Table 3.1) without grade el and performance 
rating variables indicated that, with pre-company experience and company service held 
constant, individuals with advanced degrees received substantially higher salaries than 
individuals with less education. Controlling for educational attainment and company 
service, there was clits association between ‘alan and pre-company eisctenee and, 
controlling for schooling and seaaniil experience, there was a positive association 
between salary and company service. This effect weakened with length of service but did 


not vanish within the set of feasible differences in years of service. 


When Medoff and Abraham introduced grade level dummies into the model in the 
second run (column 2, Table 3.1) relatively little of the return to educational attainment 
| took the form of higher within-grade-level earnings. Controlling for pre-company 
experience and company tenure, systematic within-grade-level earnings differences 
accounted for an average of 13 percent of the total earnings differential between 


_ advanced degree holders and those with only a bachelor's degree. Based on the results, 
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the authors suggested that those with higher educational attainment earn more than less 
educated workers almost entirely because they are initially assigned to jobs in grade 
levels with higher mean earnings. | 

In the next step, Medoff and Abraham added performance-rating dummies into 
the model (column 3, Table 3.1). The underlying question for this addition was why 


workers with more education, more pre-company experience, and more company tenure 


(on-the-job training) had higher within-grade-level earnings. One possible explanation 


Table 3.1. Earnings Function Estimates from Medoff and Abraham 





Te | @ | oo 
Independent Variables _| Coefficient | SE_| Coefficient | SE. | Coefficient | SE. 

ess than high school diplomal 247 | 010-075 007] _-077 | 007 
High schooldiploma | -131 | 005-013] .003| -012 | 003. 
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erformance rating 2" 


Master's or law degree | 104 | .010| 022 | 006] 020 | .006 

Doctorate —sSSSSS~*dSCCtia «025 | 051+ 016 | 054] 016] 

Pre-company experience (year) | 043 _|.008| 023 | .005| .027 | .005 | 

Pre-company experience square | _-.003_|.003 | _-.003_| .002 | -.004 | .002 

Company service (year) | 202 _|.008| .087 | .006| 088 | .006. 

Company servicesquare | -031 | .002| _-.013_ | .001 
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> Performarice ratings: 1- Not acceptable, 2- Acceptable, 3- Good, 4- Outstanding. 
Source: After Ref (13). 
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was that such workers had acquired valuable skills during their years in school and in the 
labor force and as a result their productivity (job performance) exceeded that of less 
educated, less experienced workers in the same grade level. If this explanation were 
valid, the authors would have expected that the heodaeded of | performance rating | 
dummies into the semi-log salary equation with grade level controls would fieve the 
estimated coefficients of the schooling, pre-company experience, and company tenure 
variables toward zero. However, although higher rated performance was associated with 
significantly and substantially higher earnings, introduction of performance ‘rating 
dummies had virtually no effect on the relevant education and experience (on-the-job 
training) variables. Thus, Medoff and Abraham concluded that within groups of similar 
jobs, despite the positive correlation between human capital and earnings, there did not 


appear to be a positive correlation between human capital and job performance. 


To enhance their findings, the authors offered another way of pene at the 
earnings-performance nexus. They categorized employees’ salaries and performance 
ratings into three levels: below average, average, above average. Then, they specified two 
multinomial logit models to estimate the effects of education, pre-company experience, 
and company service on the probability of an individual being in each of the salary 
categories and in each of the performance categories. If the higher within-grade-level 
earnings of those with more heen and more experience had been a reflection solely 


of the higher relative productivity of such workers, the authors would expect the 


estimated coefficient in the salary category model to equal the estimated coefficients in 


the performance category model. In fact, the estimated coefficients in the salary category 
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model were found to be markedly different from those in the performance category 
model. The results suggested that those with less than a college education appear to have 
a much lower nt of being in one of the oy two salary alee ores than do those 
“whose highest degree is a bachelor’ S decree, but an equal or higher probability of being i in 
one of the top two performance categories. Those with advanced degrees, on the other 
hand, were found to have a substantially higher probability of being in one of the highest 
on earnings categories than those whose final degree was a Bachelor's degree. However, 
‘these same people had a substantially higher probability at one company and a 
substantially lower probability at the other of being in one of the top two performance 


categories. [Ref. 13]' 


In his study titled "Pay, Experience, and Productivity: The Government-Sector 
Case," Bruce Dunson investigated the question of whether the findings of Medoff and 
Abraham for iaiieinn workers would apply to federal government workers [Ref. 
15]. The study replicated one of the Medoff-Abraham tests to examine whether 
differences in earnings for a select group of civilian middle managers and professionals 
in the Department of Defense could be explained by the hypothesis that more 


experienced workers were more productive workers. 


For the study, he used the Department of Defense Civilian Master and 
Transaction File, which contained the personnel records of all civilian employees in the 


DoD. This is the same file that we use in this thesis. The analysis in his study was based 





' Medoff and Abraham replicated their study in 1981 using personnel records of a different U.S. 
manufacturing corporation. The results they found in this second study were strikingly similar to those in 
the first one. [Ref. 14] 
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on the data for white males working full time in the continental U.S. with general merit 
13, 14, and 15 pay plans (grade levels). Each file contained information on an employee's 
education, birth date, service date, and region of country lous employed. The schooling 
‘ihetalion in = file was used to categorize individuals by highest level of educational 
achievement. The categories were less than high school, high school diploma, bachelor's 
degree, master’s or professional degree, and doctorate. As an index of employee 
performance, this study used the performance rankings required by the Civil sevice 
Reform Act of 1980 and its implementing regulation. The performance ratings were 1 = 
outstanding; 2 = exceeds fully successful; 3 = fully successful; 4 = minimally successful; 
5 = unsatisfactory. Since very few people were rated as unsatisfactory, only categories 1 


through 4 were used in the analysis. 


In the analysis, a standard semilog earnings equation of the following form was _ 


estimated where Y was annual salary, X represented a vector of personal characteristics, 
InY =XB+e 


B was a vector of parameters to be estimated, and e was an error term. As in Medoff and 
Abraham the estimation was done in three stages: (1) no controls for performance ratings 
and grade levels; (2) control for grade levels; (3) control for both performance ratings and 


grade levels. 


In all agencies (Army, Navy, Air Force, and Other DoD), when education and | 
differences in age and region of the country were controlled, the more experienced 


employees earned more than their less experienced peers. Dunson found that M.A. and 
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Ph.D. degree holders generally earned more than those with a B.A. degree did because 
they were in grades with higher mean earnings. Within-grade earnings differentials were 
consistently smaller for those with a Master's or professional degree compared to those 


with a B.A. only. Table 3.2 shows the results of the Dunson study. 


In the study, Dunson’s main assumption was that the performance ratings 
reflected relative productivity. The performance variables, when statistically significant, 
produced results that were consistent with this assumption. Controlling for education 
level, experience and grade, persons receiving higher rated performances on average 


earned more compared with those with lower performance evaluations. 


The major finding of the study was that performance did not seem to be a 
significant mediating factor in the positive within-grade-level association between ibe 
force experience and earnings. In this regard the findings were consistent with those 
observed by Medoff and Abraham. It appeared also to be true for similar groups of jobs 
in the government sector that, although human capital and earnings were positively 


correlated, there was no positive correlation between human capital and performance. 


[Ref. 15] 


32 








Table 3.2. Earnings Equation Estimates from Dunson 
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Table 3.2 (Continued) 
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-0.07; -0.039] -0.042} -0.047) -0.016) - -0.026 
0029} 2014] C014] (057) 024) (025) 
-0).067 ; -0.035; -0.024| -0.018] -0.019 

(0.002) (0.002| (0.008) (0.008) (0.005 
0.042; 0.003; 0.003; 0.065; -0.006} -0.006 

(0.002) (.002)| (0.008) (0.003) (0.003) 
0.149} 0.038} 0.038) 0.132} 0.014) 0.013 

008] 008] (0016 (0.007) (0.007 
0.031] 0.051} 0.048! 0.037} 0.074) 0.082 

008) 008] (0057| (0.015), (0.08 
0.001; -0.002; -0.002]/. 0.002) -0.006} -0.007 

0.003] @000| 001] (6.006) (002), (0.02) 
0.207} 0.136} 0.139] 0.099 0.08} 0.078 

(005) (0.005) (0019) (0.008) (0.08) 
-0.022} -0.014| -0.014}) -0.005| -0.003] -0.003 
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Grade level (13,1415) 
Ro SS*@Y:C«8 22] 0.840.846] 0.247 





a.(1) No controls for performance ratings and grade levels. 
(2) Control for grade level. 
(3) Control for both performance ratings and grade levels. 
b.Standard errors in parentheses. 
c. Performance ratings: (1) outstanding; (2) exceeds fully successful; (3) fully successful; 
(4) minimally successful. 
Source: From Ref. (15) | 


Various weaknesses of the Dunson study can be mentioned. First of all, the data 
file used for the analysis is not described adequately. For example, grade level dummies 


are introduced in the second step of his model but there is no explanation of why only 
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pay grades 13, 14, and 15 = included in the sample. Additionally, _all educational 
attainment variables (less than high school, high school diploma, Bachelor's degree, 
Master's or professional degree and Doctorate) were included in the sample. It is. 
questionable to compare high ahaa dropouts with Master's or PhD. ieee holders. It 


would be better to restrict the data to individuals with a Bachelor's degree or above. 


In a recent study, Bowman and Mehay examined the specific relationship between 
graduate education and on-the-job performance for professional employees in a single, 
large, hierarchical organization [Ref. 16]. The study examined the effect of graduate . 
education on job success using a unique micro database consisting of officers in the U.S. 
Navy. The study concentrated on promotion as the performance measure; however, 
information on supervisor evaluations was also used. Their promotion model focused on 
promotion to grade 4, which is the first significant control point in an officer's career and | 
involves an “up-or-out” decision. The basic information was drawn from the Navy's 
Promotion History File, which provided background information on all officers reviewed 
for etalon between 1985 and 1990. This file was augmented with supervisors’ 
evaluations (fitness reports) prior to the grade 4 promotion review. There were 4,471 
observations in the data file. Officers were classified into two occupational categories: 
line and staff specialties. 

In the empirical eae cognitive abilities were specified as a function of college 
grade point average, a technical undergraduate degree in science, engineering, or 
mathematics, or a graduate degree. Proxies for affective skills were based on accession 


source - the Naval Academy, an ROTC scholarship, Officer Candidate School (OCS), or 
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the enlisted ranks. Demographic factors, such as gender and race, marital and family 


status, and fiscal year dummies also were included in the model. 


The authors found that the estimated coefficients of an M.A. degree from any 
source had the expected signs and generally were statistically initia They ‘ia four 
model! specifications. In all specifications, the graduate degree coefficient was positive 
and significant. But the effect of graduate education was reduced as additional controls, 
some of which were likely to be correlated with an M.A., were included. When the 
additional controls were entered in the model, there was a roughly 40 percent drop in the 


effect of graduate education on promotion. 


| Of the officers with graduate degrees, the majority (75.1 percent of line officers 
and 70.8 percent of staff officers) received them via the Navy’s funded program, which 
pays tuition and salary uring attendance at graduate school. They stated that the 
measured effect of funded education would be biased upward if the organization assigned 
more able persons to graduate school (administrative bias) or if the individuals based 
their attendance at graduate school on the expected returns (self-selection bias). That is, 
those who accepted funding viewed the benefits (in the form of higher promotion or 
better assignments) as exceeding the cost of the additional service time; those who. 
rejected the funded program probably either did not expect to remain in the Navy owing 
to superior civilian employment opportunities or because they did not like the Navy. 
They addressed this selection bias issue by using a two-stage bivariate sieht model. 
They first estimated a probit model of the determinants of graduate school attendance, 


which assumed the attendance was based on expected returns and individual 
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characteristics such as sex, age, marital status, and race/ethnicity. Their graduate school 
model included proxies for the likelihood of being selected for the graduate education 
program. 

Their two-stage bivariate probit model provided evidence that a large part of the 
promotion effects in the single stage models was explained by the selection of more able 


officers into the graduate education program. For staff officers, for example, the effect of 





an M.A. fell by 50 percent. Their results are displayed in Table 3.3 and 3.4. Table 3.3 
looks at the effect of an M.A. from any source and Table 3.4 looks at the effect of M.A.'s 


fully funded by the Navy. 


Table 3.3. Coefficient of Any Master's Degree in Single Stage and Bivariate Probit 
Models in Bowman and Mehay Study 


(1) | @) 5 (3) 


No controls for Controls for Bivariate 


| ability/performance | ability/performance Probit 


Line Officers | (.073)° (.065) (.075) 
[.098}° [.065] 


903 ' < . 188 
Staff Officers ~— (.063) (.108) 
[.145] | [.051] 
“Standard errors in parentheses 
Marginal effect in brackets 
Source: From Ref. (16) 





The authors also looked at the effect of the fully funded graduate education 
program. The results revealed that for line officers the return to a funded degree was 
nearly double what it was for any M.A., and for staff officers it was about 20 percent 


higher (compare column 1 of the tables 3.3 and 3.4). Thus, the positive return to an M.A. 
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observed in single stage estimates appeared to be sided to the funded degree program. 
However, comparing Tables 3.3 and 3.4 suggested that selection bias was greater for the 
funded pera than for other M. A. program. Positive siiiailan reduced the return to any 
Master’s degree by about one-third for line officers, and it reduced the return for funded 
degrees by nearly by one-half. For staff officers, the return to any M.A. was reduced by 
two-thirds, but by nearly three-fourths for funded degrees. Two conclusions emerged 
from their analysis: (a) both firm specific and general types of investments aepeat to” 
yee a positive return to the officers 1 in the Navy; and (b) selection or ability bias 


accounts for a large portion of the measured return to Master’ s degrees in the Navy. 


Table 3.4. Coefficient of ¢ Fully Funded Master's Degree in Single Stage and Bivariate 
Probit Models in Bowman and Mehay Study 
Controls for - Bivariate 


(1) 
No controls for 
it, ability/performance | ability/performance Probit 
605 .460 .250 
Line Officers (.067)* (.074) (.057) 
[.148]° ) [.093] [.068] 
615 | 447 154 
Staff Officers (.072) 
[.172] , | 


“Standard errors in parentheses 
*Marginal effect in brackets 
Source: From Ref. (16) 



















(2) (3) 
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IV. DATA AND METHODOLOGY 


This chapter describes the data set used in this study and explains the 


methodology for constructing multivariate performance models used to measure the 


effects of graduate education on job performance. It also provides descriptive statistics 
about each data set used in the models. Section B describes each of the four models © 


(salary, promotion, retention, and performance rating) and how they were constructed. 
A. DATA DESCRIPTION 


The data used in this study were drawn from DoD Civilian Data Files provided by 
the Defense Manpower Data Center (DMDC). Two different data files are available for 


DoD civilian personnel: (1) an inventory (current status) file, and (2) a transaction 


- (dynamic) file. Both files contain similar data elements. Appendix A provides a list of © 


those data elements as of January 1998. These two files cover personnel paid from 
appropriated funds in all Defense agencies except the National Security Agency, the 
National Imagery and Mapping Agency, | and the Defense Intelligence Agency. They 
exclude coverage of fio national direct and indirect hire civilian employees outside 
the 50 states and the District of Colombia. For our research, DMDC merged these two > 
files into one file including only selected data dienients: These elements were selected 
based on their use, in either identical or similar forms, in prior studies on graduate 
education and job performance. The new data file was restricted to full-time, career, and 
career conditional employees with at least BA/BS degrees and who were paid under the 


General Schedule (GS) or General Management (GM) pay systems in September 1986. — 


39 


These same individuals were followed by two-year intervals until 1998. The file also 


provided a last snapshot in February 1999. This data file was.converted into a SAS 


(Statistical Application Software) file and analyzed on the NPS mainframe computer 


system. 


The General Schedule (GS) and General Management systems were chosen for 
the analysis in this thesis because they are the primary white-collar pay systems and they 
cover almost two-thirds of the entire defense civilian workforce. Aeiies reason was that 
their positions have been classified into 18 grades based upon the difficulty and 
responsibility of the work performed. Grade increases in the system lead to rises in | 


salary, status, and authority. 


The data file used in the analysis in this thesis contained 213,482 observations and 
41 data elements. These data elements esneined of personnel demographics and 
backerouna information such as sex, race, age, educational attainment, veteran status, and 
federal service years, among others. A full list of these data elements is presented in 
Appendix B. Among the 213,482 employees, 76 percent held BA/BS degrees while 20.9 
and 3.1 percent held MA/MS and Ph.D. degrees as their highest educational degree, 


respectively. Tables 4.1 and 4.2 provide complete descriptive statistics of the raw data. 
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Table 4.1. Descriptive Statistics, September 1986 Defense Civilian Personnel 
(Inventory Data) 


* Includes Marine Corps. 
Source: DMDC 





Other White Collar 
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Table 4.2. Descriptive Statistics, September 1986 Defense Civilian Personnel 


(Inventory Data) é 


Number of 
observations 
213,482; $33,331 


|Federal Service (years) 213,482 12.91 
Age (years) 213,48 40.51 


Source: DMDC | 
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METHODOLOGY 


The purpose of this research is to investigate the relationship between graduate 


education and on-the-job performance of DoD civilian employees. One way to pursue 


_ this research is to statistically model the causal relationship between the two factors. 


However, such a model requires quantifiable measures for graduate education, on-the-job 


_ performance, and all other relevant elements that may affect measured on-the-job 


performance. Yet there appears to be no completely satisfactory way of measuring job 


performance in DoD, or even of defining it. We therefore assume that differences in job 


performance across individuals are reflected in the available measures of success within 


the DoD and that rewards within the DoD are based on job performance, or at least on 


perceived performance. The measures of job-performance include salary level, 


promotion, performance ratings, differential between consecutive salaries, time elapsed 


between consecutive promotions, and retention. 


42 




















In this study, we chose to focus on four of the aforementioned performance 


measures; salary level; promotion, performance ratings, and -retention.. These four 
measures were the most appropriate job performance indicators we could used to develop _ 
performance models with the data at hand. The specifications of these four statistical 


performance models are presented in detail in the following sections. 


We based our performance models on the assumption that individuals with higher 
educational attainment are more likely to work in higher cana levels. These individuals 
are likely to have higher earnings, but lower probabilities of promotion. Because the 
grade levels in GS/GM systems are based upon the difficulty and responsibility of the 
work performed, higher grade levels call for higher salaries for their occupants. However, 
promotion probabilities should be lower at higher grades because srenonons generally 
are vacancy driven and there are usually fewer openings at higher levels in the 
organization. | 

Based on these assumptions, we analyzed the salary and promotion models with 
and without controls for grade level. The model with no controls for grade level estimates 
- the avecsll effect of individual traits, especially educational attainment, on: job | 


performance while the model with controls for grade level estimates within-grade effects. 


In a second set of models, we ran the same four performance models with a 
senicle restricted is the cohort of employees who were hired in 1986, suite that they 
comprised a better sample since they started to work in the same year and had no 
_ previous service background in the DoD. These models provide the salary, retention and 


performance. rating experience of new hires in DoD agencies. 
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A. Salary Model 


Numerous studies of returns to investment in human capital have demonstrated 
quite clearly that’ more educated workers ‘earn more than those with less education. 
According is human capital theory, an individual chooses the eccnpation and level of 
education that maximizes the present value of his/her expected lifetime earnings. It is 
generally assumed that education increases an individual's productive capacity to perform 


job-related tasks. [Ref. 10] 


We constructed one of our models on this basic assumption of human capital 
theory by using salary as a measure of job performance. If we consider that the employee 
appraisal systems within the DoD are based on merit, we can expect that better 
performers will earn more. Because grade level largely determines salary, especially in a 
government organization, it should be controlled for in this kind of snide To seé the 
effects of educational attainment and other relevant variables we used a standard semi-log 


earnings function: 
In) =Bo + BX te 
where 
Y= annual salary; 
) Bo- a constant term; 
X = a vector whose elements capture background characteristics, highest level of 


educational attainment, federal experience, and other salary determinants; 
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B = a vector of parameters to be estimated and; 


€ = a random error term. 


- Medoff and Abraham (1980) used a standard semi-log annual earnings function to 
investigate the wietnn between earnings and relative performance. Their data set 
consisted of employees from two large corporations in the US manufacturing sector who 
were white, male, active, full time, regular employees. In their analysis, they included all 
educational attainment categories (less than high school diploma, high school diploma, 


Bachelor's degree, Master's or law degree, and Doctorate). | 


Bruce Dunson (1985) also used a standard semi-log annual earnings function to 
find the relationship between relative earnings, experience, and rated performance with 
the same data we used for this study (i.e., DoD civilian workers). He soapdietsd the data 
to white males in either sccpedeianal or ince jobs with grade levels 13, 14, and . 


15. He also included workers in all educational categories. 


Differing from these studies, we restricted our data to only individuals with a 
Bachelor's degree or higher. This is an important restriction as it 1s appropriate to 
compare salary and performance of MA's to BA's, and not to non-college workers. We 
ran the model in two steps: (1) without controlling for grade levels; (2) controlling for 
grade levels to investigate within-grade effects of explanatory variables. The second a 
was applied to only the 1986 inventory sample. We included "grade level" as a 
continuous sanepie in the second step. In this salary model, ordinary least squares (OLS) 


techniques were used to estimate the parameters because the dependent variables, log of 
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SALARY, was a continuous variable. The reason we used a semi-log function is it 
provides the percentage effect of a change in each of the individual explanatory variables 
- on the dependent variable. Table 4,3 meieyst: definitions of the dependent and 


independent variables eed: in this model 


Our dependent variable for this model is the log of annual salary for the year 
1986. We included background variables such 7 sex and race to account for possible 
differences in the quality of schooling or in the types of college majors of women and 
minorities. We included varia attainment with the expectation that individuals with 
higher education would eam more. Similarly, experience variables were included with 
the expectation that individuals with more experience would earn more. Two types of 
experience are modeled: experience in one’s federal job, and experience in the civilian 
workforce prior to entering federal employment. Because regional economic conditions : 
have different effects on the salary, metropolitan area status and region dummy variables 
were also added to the model. Supervisory status and occupational category variables 


were also added to the model with the expectation of different effects on salary. 


Individuals less than 22 years old and above 65, and those with annual salaries 
lower than $5,000 were deleted from the data file. Individuals with missing values for the 
slide variables also were excluded from the model. After jiese adjustments, 199,070 | 
observations remained i the data file. Table 4.3 shows descriptive slatistics for this 


sample. Table C.1 in Appendix C shows descriptive statistics for the "new hires" sample. 


In our sample for the salary model, men comprise 76.8 percent of the sample and 


whites 83.8.percent. The majority of the sample (76.4%) has only a Bachelor's degree, 
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while Master's depiee and Ph.D. degree holders comprise 20.6 and 3.1 percent of the file, 
respectively. Mean annual salary for this sample is $33,498. Mean federal service and 
mean prior experience are 11.9 and 6.1 years, respectively. 

Table 4.3 Variable Definitions ad Giaintins Statistics for Salary Model 


(N = 199,070) 


_ Wariable Description 


Log of annual salary for the year 1986 
% 


FLT S| = 

AS = 
>i Si] © 
etal & 
>} 2] 

a) =| § 
| 
5 
S: 
eo 


ndependent Variables 


FEMALE 1 = Female 46,131 23.2 
0 = Male 152,939 76.8 
BLACK 1 = Black 16,262 8.2 
ena ee 
HISPANIC 1 = Hispanic 5,693 2.9 
0 = Not Hispanic er 
WHITE 1 = White 166,732 83.8 
0 = Not White a 
OTHERACE 1 = Other Race ; 10,383 5,2 
0 = Not Other Race | i 
VETERAN — 1 = Veteran | : , os 73,330 36.8 
0 = Not Veteran 125,740 
BA_BS86 1 = Individual has a Bachelor's degree in 1986 152,074 76.4 
: 
MA_MS86 | 1 = Individual has a Master's degree in 1986 40,922 20.6 






0 = Individual doesn't have a Master's degree in 1986 












PHD86 1 = Individual has a Ph.D. degree in 1986 6,074 3.1 
0 = Individual doesn't have a Ph.D. degree in 1986 — = 
METROP86 1 = Metropolitan Area 162,189 81.5 
0 = Not Metropolitan Area 
NEWENG 1 = Census Region is New England | 8,877 4.5) 
| 0 = Census Region is not New England as 
MIDATLAN 1 = Census Region is Mid Atlantic 22,624 11.4 
| 0 = Census Region is not Mid Atlantic oat | 
EASTNC 1 = Census Region is East North Central | 22,321 11.2 
_ #0 = Census Region is not East North Central | 
WESTNC 1 = Census Region is West North Central 9,641 om) 
0 = Census Region is not West North Centra! as 
SOUTHAT 1 = Census Region is South Atlantic 32.2 


0 = Census Region is not South Atlantic 





Table 4.3. (cont.) 















EASTSC 1 = Census Region is East South Central 13,043 
0 = Census Region is not East South Central 
1 = Census Region is West South Central 
0 = Census Region is not West South Centra 
1 = Census Region is Mountain 


a | 0 = Census Region is not Mountain 

PACIFIC 1 = Census Region is Pacific 3 31,500 15.8 
QncmRepmnsonrete || 
SVISOR 1 = Individual has supervisory position —_- 30,281 25.3 
ek | 0 = Individual doesn't have supervisory position 
PROF 1 = Occupational category is Professional : 105,946 53.2 

0 = Occupational category is not Professional 

1 = Occupational category is Administrative 
0 = Occupational category is not Administrative 
] = Occupational category is Technical 


0 = Occupational category is not Technical 
CLERK 1 = Occupational category is Clerical 10,564 5.3 





WESTSC 16,825 8.5 








MOUNTAIN 10,085 51 





























ADMIN 





69,114 34.7 















TECH* 12,930 6. 


LA 














0 = Occupational category is not Clerical 
OTHERWC 1 = Occupational category is Other White Collar 516 0.3 
0 = Occupational category is not Other White Collar. 


FEDYEAR | Federal Service in years a, 199,070 11.9] 
SFEDYEAR | Square of Federal Service 199,070) 227.27 


PRIEXP ____—*Prior Experience inyears_——S—SSCSCS~SCSS~S IB, OTO| 609 


* Base Case Variable 
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2: Promotion Model 


When salary is used as a measure of job performance (or productivity), there is an 
implicit assumption that salary is somehow adjusted to match individual performance. 


But in practice, salaries are normally attached to positions in a firm, and not to the 
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individuals filling them at any particular time. In many large organizations, especially in 
government organizations, each position is assigned a grade level-and a "basic salary" or 
wage is associated with each level. This is sometimes referred to as the "salary structure" _ 
- of the ieuiialiiiliae Normally, the higher the eeaion in the firm hierarchy, the higher the 

salary. Although an individual's salary is largely determined by the position he/she holds 
at any eveactiines this basic salary may be adjusted for years employed, more or less 


automatically. [Ref. 12] 


This suggests that the rate of upward movement ‘of an individual in the 
organizational hierarchy may be a more direct measure of job performance than is his/her 
rate of salary increase. This assumes, of course, that persons who are judged by the firm 
to be "more capable" are promoted faster. Looking at promotions may also yield 
quantitatively different results than salaries may show, because persons who are not 
promoted from one level to the _ may still receive sileicaaes in salary. Thus, 
differences in grade levels between persons and promotions from one level to the next 
may suggest greater individual differences in on-the-job performance than are implied by 


salary differentials. [Ref. 12] 


We therefore developed the following praniouen model based on the preceding 
assumptions. We examined federal employees serving in the DoD in 1986 and looked at 
— promotion histories through 1992. The purpose of or a 6-year sefibl was to 
allow variation over time while keeping a large number of observations for better 
statistical reliability. The dependent variable PROMOTE for this model was derived by 


distinguishing those individuals who were promoted at least once between September 
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1986 and September 1992 from those who were not. The data set provided "date of last 


promotion" for each federal employee, which is the data element used to construct the 


dependent variable. If the individual's date of last promotion taken out of the 1992 data 


set fell between 1986 and 1992, the dependent vaiable PROMOTE took a value of 1, 
otherwise it took the value of 0. Because the dependent variable is binary, the probit or 
logit models of binary outcome are more appropriate estimating procedures than linear 
multiple regressions. The most Seite consideration is that the use of a multiple 
regression model to predict promotion may result in predicted values greater than 1 or 
less than 0 in some cases. Because such predictions are meaningless, the preferred 
procedure is to use a non-linear fualidtias such as probit or logit, which estimate S- 


shaped curves with asymptotes at the value of 0 or 1 so that all predictions fall inside the 


range of 0 to 1, meeting the test of making realistic predictions. Because there does not 


seem to be any clear criterion for choosing one of these specifications over the other, we | 


chose the logistic specification. 
The basic logit model can be written as: 
Prob(Promote)=By +BX+e 
_ where; 
Prob(Promote)= The probability of promotion for individual i, 


X= a vector of personal demographics and background characteristics that may 


influence the promotion behavior, 


B= a vector of coefficients for the X factors, 
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6.= a constant term, and 


€= an error term. 


As a first step a isin the data used in this model, we excluded federal 
employees who left DoD by September 1992 because the dates of their last promotions 
were not available. Next, we cestieid the data to federal employees whose educational 
attainments remained anehaneed during the 1986-1992 setiod That is, those who 
attained an additional degree between 1986 and 1992 were excluded because on-the-j i 
performance or grade might have been affected by the additional education. A final 
restriction was the exclusion of individuals whose age in 1986 Gee less than 22 or 


greater than 65. After the restrictions, the sample size for this model equals to 128,069. 


In specifying the model, we chose explanatory variables based on the prior 
research studies cited above in Chapter 3. The promotion model was specified 6 look at 
an individual's success in being promoted between 1986 and 1992. The following 
paragraphs will provide a further explanation of each eqeinnaion variable included in the 


model. 


Much of the literature on promotions uses data provided by individual firms. 
There are also a few studies using panels of workers. One result found consistently in all 
studies of promotion is that promotion rates fall with age or experience. Tenure effects on 
promotion are less consistent across studies, with evidence both for positive and negative 


effects. Steward and Gudykunst (1982) find positive effects, while Medoff and Abraham 
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find negative effects (1980) [Ref. 17]. In our model, we controlled for firm-specific 


experience by including a variable for years of federal service. 2 


Education effects are frequently not significant in prior studies (e.g., Lewis 1986; 


Hersh 1993), but where significant effects have been found, higher levels of education 


are associated with a greater likelihood of promotion, particularly at lower levels of 


education (e.g. Rosenbaum 1979) [Ref. 17]. For our model, we split the educational | 


attainment into three categories; Bachelor's degree only, Master's degree, and Doctorate. 


Performance ratings are usually considered as one of the most significant basis for 
promotion in firms. These ratings should reflect actual performance differentials between 
employees in a firm, or at least performance differentials as perceived by supervisors. 


The literature provides evidence that performance ratings are significant indicators of 


promotion incidence (e.g., Mehay and Bowman (1999); Medoff and Abraham (1980)). | 


Thus, one should control for performance ratings in a promotion model. Performance 


ratings used in our model have five distinct levels: 1- Unacceptable, 2- Level between’ 


unacceptable and fully successful, 3- Fully successful, 4- Level between fully successful 
and outstanding, and 5- Outstanding. Performance ratings levels were not provided for 
almost two-thirds of the observations in 1986. Thus we measured each individual's 


performance rating in 1988. 


Some studies have found that women have higher promotion rates than men 
(Gehart and Milkovich 1989; Hersh 1993), while other studies have found that women 
‘have lower promotion rates (Cabral et al. 1981), and yet others have found that promotion 


rates for men and women are equal (Lewis 1986) [Ref. 17]. Because most of these studies 
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are based on data for one or two firms, conclusions drawn by the authors may be specific 
to the firm under consideration, which may explain inconsistencies in their findings. We 


added the variable of FEMALE to test for gender differentials in promotion. 


- Veteran's preference offers sibeeaniial advantages on entrance siesiihiaitina for 
federal employment, but no explicit advantage in the promotion process. Despite 
preferential hiring treatment, veterans appear to earn ee than comparable non-veterans 
in the federal service (Corazzini 1972, Lewis and Emmart 1984, Longs 1976, Taylor 
1979). Taylor (1979) has argued that veterans’ advantage in initial placement puts them 
into jobs for which they are not fully qualified, and that consequently they are not 
promoted as rapidly as non eeiaG [Ref. 18]. Thus, the variable VETERAN was 


included to test for potential promotion differentials between veterans and non-veterans. 


~ Another significant factor that should be Saneidered in a promotion model is the | 
promotion sueniatialiial available to individuals. Each individual is considered for 
promotion only when a position becomes vacant due to promotion or separation of the 
incumbent or when a new position is created. Even though individuals may have the 
same characteristics, they will not have the same likelihood of being promoted priniarily 
because they are working in different locations throughout the organization or in different 
occupations. Vacancies can differ widely by activity and occupation. Furthermore, 
promotion chances should decline at higher grades tea there are usually fewer jobs at 
those levels. The relationship may not be linear, however. In the case of DoD employees, 
we believe that most MA/MS degree holders occupy higher grade levels. Thus, the model 


must control for promotion opportunities. This is accomplished by including dummy 
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variables for supervisory status, occupational group, functional area, and grade level. 


Occupational groups were split out into five categories; professional, administrative, 
| pane ena and "other" white colle Functional areas were divided into fleet, 
intelligence and communication, training and A iacstion: medical, and oe 
activities. Finally, in accordance with our main assumption Stated above in the 
methodology section, grade level was controlled in the second stage of this model. The 
model also included several dummy variables for race or ethnicity to capture differences 
that stem from different social backgrounds. Race ethnicity is defined as BLACK, 


HISPANIC, WHITE, and OTHERACE. 


Table 4.4 defines the variables included in the model and provides descriptive 


_ Statistics. As seen in the table, 70,442 of the 128,069 observations were promoted during 


1986-1992, which accounts for 55 percent of all observations. Bachelor's degree holders | 


comprise 74.6 percent of the sample while Master's degree and Ph.D. degree holders 
account for 22.2 and 3.2 percent, respectively. Mean year of federal service is 11.5 years. 


Table C.2 in Appendix C gives descriptive statistics for the "new hires" sample. 
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Table 4.4. Variable Definitions and Descriptive Statistics for Promotion Model 


(N=128,069) 
Variable Name 7 Variable ee ) 





{Dependent Variable . 





PROMOTE . [1 = Promoted by 1992 ued ial 

pom eee 

FEMALE | =Female : | 27,547] 21.5 

BLACK 1 = Black 10,181] 7.9 
0 = Not Black 

HISPANIC |=Hispanic 3,999| 3.1 


0 = Not Hispanic 


WHITE* _ {1 = White 107,058] 83.6 
perma 
OTHERACE ] = Other Race | 6,831 5:3 
a Dia mm ane 
VETERAN _ |) 1 = Veteran 82, 327 


BA_BS86* | 1 = Individual has a Bachelor's degree in 1986 95,598 = | 


0 = Individual doesn't have a Bachelor's degree in 1986 


MA _ MS86 1 = Individual has a Master's degree in 1986 28,374| 22.2 
= Individual doesn't have a Master's degree in 1986 


0 
PHD86 1 = Individual has a PhD degree in 1986 4.097 | 3.2 
) 0 = Individual doesn't have a PhD degree in 1986 
$1 0.1 


1 =Rating level is | 





2 =Rating level is 2 
3 =Rating level is 3 
4 =Rating level is 4 





5 =Rating level is 5 


1 = Individual has supervisory position 
0 = Individual doesn't have supervisory position* 





33,474; 26.1 
94,595| 73.9 


SVISOR 
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1 = Occupational category is Administrative ~ 46,030} 35.9 


0 = Occupational category is not Administrative 





1 = Occupational category is Clerical . 5,762 4.5 


0 = Occupational category is not Clerical 


‘|| 1 = Occupational category is Other White Collar 257 0.2 
0 = Occupational category is not Other White Collar 


1 = Functional area is Fleet 13,607 
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0 = Functional area is not Fleet 


1 = Functional area is Material { 71,323 55.7 
0 = Functional area is not Material 
5.9 


1 = Functional area is Training and Education 7,553 





0 = Functional area is not Training and Education 
1 = Functional area is Medical 2,833 2.2 
promionieesmavedat || 
~ 11 = Functional area is Department Headquarters 2,659 2.1 
tRoiol am saw Dwmettes || 
1 = Functional area is Administrative Activities 23,466 18.3 
0 = Functional area is not Administrative Activities a“ 
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Federal Service in years . 128,069 


GRADES86 Grade level in 1986 128,069| 10.94 
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1 = Occupational category is Professional 68,081] 53.2 
0 = Occupational category is not Professional 

1 = Occupational category is Technical 7,939 62 
0 = Occupational category is not Technical . 


1 = Functional area is Intelligence 6,628 5.2 
- }0 = Functional area is not Intelligence | 





3. Retention Model . & 


From the perspective of an individual worker, the human capital model suggests 
that changing jobs is a costly bisa: that will be undertaken voluntarily only if the 
net expected benefits are relatively large. Workers, then, are seen as using job mobility as 
a means of improving their personal well-being. From a more global perspective, 
however, worker mobility performs the socially useful role of matching workers with the 


employers who value their skills most highly. [Ref. 9] 


Organizations want to retain qualified and experienced employees in their 
spar orce. Retaining the most qualified employees is very important in increasing the 
productivity of the workforce and reducing manpower costs. Similarly, the organization 
must retain people for some period of dine to be able to sittin lili costs and 
realize a positive return on its training investments. Individuals will want to quit if their 
talents can command a higher wage (presumably because they are more productive) 
elsewhere; otherwise they will stay. The decision to stay or leave is primarily an 
individual decision, so it is important to take into account the individual chanacten sees 


that may explain retention. 


We classify the factors that effect retention and job mobility into four categories: 
(1) wage effects; (2) cyclical effects; (3) age and job tenure effects; and (4) the costs of 


quitting. The effect of these factors can be summarized as follows: 
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e Human capital theory predicts that, other things being equal, a given worker will 
have a greater probability of quitting a low-wage job than a higher-paying one; 


e Another implication of human capital theory is that workers will have a higher 
probability of quitting when it is relatively easy for them to obtain a better job 
quickly; 


_@ The prediction that younger workers are more likely to make human capital 


investments of all kinds appears to be true for job mobility investments as well: 


e Economic theory predicts that when the costs of quitting one's job are relatively 


low, mobility is more likely. [Ref. 9] 


Many studies have been done about employee turnover and retention in the 
civilian sector. In 1987 Richard A. Ippolito conducted a study related specifically to quit 
rates in the federal government [Ref. 19]. Quit rates in the federal government were 
observed to be below those in the private sector. Some economists and the federal 
government itself had taken this to mean that federal wages were too high. His study 
provided an alternative eiesianahon: It showed that the timing of compensation across : 
career as well as its level affects quit rates. The federal pension system, in particular, 
imposed large penalties on workers who quit early. And the portion of pay in the form of 
pensions was much higher for federal workers than for comparable non-federal workers. 
He actin that this feature of the federal pay system explained the abnormally low 


quit rate among federal workers. 
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With the assumption that the DoD would retain civilian employees who perform 
better, we used retention as another performance measure. We built a logit model to see 
the effects of different explanatory variables on retention, measured as a binary outcome, 


- whether a person decides either to stay i not. The basic sagdel can be written as: 
_ Prob(Staying) = B. +BXt¢ 
where 
Prob(Staying) = probability of staying over a given period; 


X =a vector of personal demographics and background characteristics that may 


influence the retention behavior; 
B _ a vector obvaniauiets to be estimated; 
6. = a constant term; and 
€ = an error term. 


First, we took the entire inventory in September 1986 and then followed these 
individuals until September 1992. If an. individual remained an employee of DoD 
between 1986 and 1992 the dependent “waabie RETENT92 takes the value of 1; if he/she 
did not, it takes the value of 0. Explanatory variables in the model include individual — 
characteristics such as sex, race, age, and veteran status. Different functional areas may 
affect individual stay/leave decision because of different work environments and job 
satisfaction. For this reason dummy variables for “functional area” were pase in our 


_ retention model. A Federal service variable was also added to the model, but the model 
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was restricted to individuals with fewer than 15 years of federal service in 1986 because 
at the large effect on retention of individuals who were close: to the retirement. For 
_ educational attainment, we included i in the sample only those individuals without any 
change in education level indie 1986 and 1992. Differing — the pronieticit model, 
we included rerforniance ratings” by | eaciistue the average rating between 1986 and 
1992. The model took into account the available sande of ratings for every individual to 
calculate average rating. Obviously, those who left tended to receive fewer performance 
evaluations than those who stayed. We also excluded missing observations from the 
model. After these adjustments, there were a iaal of 112,953 observations in our model. 


Table 4.5 describes the dependent and independent variables in the model and provides 


descriptive statistics. We also ran the same model on the sample restricted to new hires in 


1986 (See Table C.3 in Appendix C).. 
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Table 4.5 Variable Definitions and Descriptive Statistics for Retention Model 
(N = 112,953) 


Variable Name Variable Description | 
Dependent Varable—fCCid SN 


RETENT92 . | il = Individual is still in DoD in 1992 | 88,936 78.7 
Pe 0 = Individual is not in DoD in 1992 24,017 21.3 


+> >. a a = =] 

y < b| fs S eZ = | COS & 
6 s 53g et 3 mS! 
Q S ~a Of O Z ss =] a = 
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Fe etm be 
FEMALE 1 = Female 34,342 30.4 
BLACK 1 = Black 10,808 

pe pane TL 
HISPANIC 1 = Hispanic 3,584 3.2 
per penottipmie | 


WHITE 1 = White 91,392 80.9 
10 = Not White 


OTHERACE 1 = Other Race a 7,169 6.3 
pe enocontermae 

. 1 = Veteran 29,000 25.7 
1 = Individual has a Bachelor's degree in 1986 87,957 77.9 
o=indvisldecrttve abate degeein toss | | 


>| & 
Sosy 
a 

Zz 


1 = Individual has a Master's degree in 1986 21,437 
0 = Individual doesn't have a Master's degree in 1986 










1 = Individual has a Ph.D. degree in 1986 3,559 3.1 
0 = Individual doesn't have a Ph.D. degree in 1986 : 
1 = Functional area is Fleet | 10,621 
0 = Functional area is not Fleet 

INTEL 1 = Functional area is Intelligence 5,513 4.9 

| 0 = Functional area is not Intelligence 

1 = Functional area is Material 61,356 54.3 
0 = Functional area is not Material ‘ 
1 = Functional area is Training and Education 7,313 6.5 
0 = Functional area is not Training and Education 
1 = Functional area is Medical 4,168 3.4 
0 = Functional area is not Medical 
1 = Functional area is Department Headquarters. -. 2,661 2.4 


0 = Functional area is not Department Headquarters 
1 = Functional area is Administrative Activities 


21,321 
0 = Functional area is not Administrative Activities 


EDYEAR Federal Service in years 112,953 
Average performance ratings between 1986 and 1992 112,953 
AGE86 Age in 1986 112,953 36.05 
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4. Performance Ratings Model 


” 


Performance ratings are seca as soft and subjective measures of on-the-job 
productivity by many researchers since they are subj ect to ‘several weaknesses. One 
potential weakness is that supervisors may be overly lenient in rating their subordinates; 
that is, some supervisors might be "harsh raters" and some others might be "easy raters." 
Harsh raters give evaluations that are lower than the "true" level of performance (if it can 
be ascertained); this is called severity or negative leniency, whereas easy raters give 
| evaluations that are higher than the "true" level; this is called positive leniency. This 
problem usually occurs because the rater has sualied personal standards derived from - 
his/her own personality or previous experience [Ref. 20]. A second potential weakness 
of performance ratings is that an employee's personal characteristics (race, sex, age, and 
tenure) might influence piper icors performance Acedia For example, ‘the 
supervisor may have a generally favorable attitude toward an employee that will 
permeate all evaluations of this person. Typically, the supervisor has strong feelings 
about at least one important asec! of the employee's performance or characteristics. This 
is then generalized to other performance factors, and the ecaplovee is judged (atross 
many factors) as uniformly good or bad. The third weakness of performance ratings, 
called central tendency error, refers to the supervisor's unwillingness to assign extreme- 
high or low-ratings. Everyone iS "average," and eiiy the middle (central) part of the 
rating scale is used [Ref. 20]. A final criticism of performance ratings might be that since 
different supervisors may have divergent beliefs about what constitutes good 


performance, ratings done by different supervisors should not be compared. While it does 
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seem unlikely. that any two supervisors would be completely consistent in their 
evaluations, the results of laboratory studies suggest that a high degree of inter-rater 


reliability can be expected [Ref. 13]. 


Despite all the weaknesses and criticisms of performance ratings, one would still 
expect that, all the other relevant factors being the same, a company would be more likely 
to promote or give salary increases to those employees in a grade level whose current 
productivity, that is, current perceived relative performance, was the highest. And we 
can say that performance ratings were, or at least should have been, the legitimate 
indicators of this perceived relative performance between employees. Therefore, we 
decided to develop a performance model based on performance ratings of DoD civilian 
employees. We expect to have the same signs and comparable effects of the explanatory 
variables as in the salary and promotion models. If the results meet our expectations, they 
will provide evidence that seunnanee ratings are significantly correlated with true 


relative productivity of civilian employees within the DoD. 


For the performance ratings model, we took into account the federal employees 
serving in the DoD in FY1986 and created a dummy variable based on whether the 
average of their performance ratings between 1986 and 1994 fell into the top half of the 
distribution of all ratings. We computed the average performance ratings over an 8-year 
period (1986-1994) because the order of salina ratings was reverse for the ast 
three years in the data file (1996, 1998, and 1999). Taking these three years into 
consideration would have required complex coding procedures. The dependent variable 


for this model, TOP, was derived by separating the observations whose average 
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performance ratings were above the mean value of all performance ratings (4.005). That 
is, 1f the individual's computed average performance rating exceeded the mean ‘eles of 
all employees in the sample; then, the dependent variable TOP took the value of 1; 
otherwise it took the value of 0. Because the isis outs takes on a value of 0 or 
1, meaning that an event either occurs or does not occur, the probit or logit abdels of 
binary outcomes are again more appropriate procedures than linear multiple regression 


| nroesdunes: 
The basic performance-rating model can be written as: 
Prob(T. op)=Bo +BX+e © 
where; 


Prob(Top)= probability of individual's average performance ratings’ being greater 


than the mean value for the entire sample; 


X= a vector of personal demographics and background characteristics that may 


have effect on performance ratings; 
B= a vector of coefficients for the X factors; 
Bo=a stain term; and 
€= an error term. 


As the first step in shaping the data used in this model, we excluded employees 
with no valid performance ratings between 1986 and 1994. We included employees who 


had one or more valid performance ratings by 1994. All of the employees who left DoD 
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before 1994 had missing performance ratings. But, instead of excluding them, we 
computed the average of their available performance ratings and retained them in the 
sample. Next, we fours the data to federal employees whose educational attainments 
remained aia between 1986 and 1994. That is, the individuals who attained a 
higher degree after 1986 were excluded because the average performance rating of such a 
person might have been affected by the change in education level. A final restriction was 
the exclusion of the individuals whose age in 1986 was not in the range of 22 to 65. In 
specifying the model, we included the same independent variables that were used in the 


salary and promotion models. 


Among the explanatory variables; FEMALE is used to conte for gender 
differentials in promotion. Racial and ethnic categories (Black, Hispanic, White, and 
"other") are added. since different social backgrounds may affect actual on-the-job 
performance, - supervisors’ perceptions of siltaiiiile Possible preferential treatment 
of veterans may also affect their performance ratings. We included sincera 
attainment in three categories; Bachelor's degree, Master's degree, and Ph.D. Education 
level is expected to be . determinant of a successful career path, and improve an 
individual's adaptability or ability to cope with job demands. Supervisory status was 
included due to the possibility that once an individual becomes a supervisor, his/her 
performance ratings would not be as likely to reflect his/her true performance a they are. 
before and might be inflated because of his seniority. The same argument may apply to 
an employee's federal experience as well. As federal experience goes up, so does 


- seniority. Therefore, "number of years in federal service" was added to model. We also 
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controlled for prior experience, which may reflect general work force experience and be a 


factor in increasing one’s performance ratings. And, finally, since the evaluation criteria 


for performance ratings and measurement of success differ across — groups as 


well as across functional areas, we : included dummies for the five main occupational 
groups (professional, administrative, technical, clerical, and other white collar) and seven 
major functional areas (fleet, intelligence ad communication, sie etnies and 


education, medical, department headquarters, and administrative activities). 


Table 4.6 describes the variables included in the model, and provides descriptive 
eminence As seen in the table, there are 78,303 individuals out of 187,049 observations 
who ranked in the top category of average performance ratings, which accounts for 41.9 
percent of all observations. Bachelor's degree holders comprise 75 percent of the sample 
wae Master's degree and Ph.D. holders account for 21.8 and 3.2 percent, respectively. 
The mean of er years of federal service is 12.2 years. The mean perormance 
rating, which was used in defining top category of performance ratings, is 4.0. Table C.4 


gives descriptive statistics for the "new hires" sample. 
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Table 4.6. Variable Definitions and Descriptive Statistics for Performance Ratings 
Model. (N=187,049) 


VariableName = Name ee eels Variable sb aes 
aoe Variable oie aiebeaee 






1 =Individual's average performance rating is greater than 41.9 
sample mean for all employees* 
0 = Individual's average performance rating is smaller than 58.1 





sample mean for all employees* 





Independent Variables 


FEMALE 1 = Female 43,581; 23.3 
0 = Male** 143,468} 76.7 


BLACK 1 = Black . 15, 219 
: 0 = Not Black 
HISPANIC 1 = Hispanic | 5,768 3.1 


0 = Not Hispanic 


WHITE** 1 = White 156,001): 83.4 
re ee 
OTHERACE 1 = Other Race 10,061 5.4 
ee ee 
VETERAN . 1 = Veteran | 116,465 62.3 


BA_BS86** = Individual has a Bachelor's degree in 1986 140,305] 75.0 
0 = Individual doesn't have a Bachelor's degree in 1986 

MA_MS86 1 = Individual has a Master's degree in 1986 40,782} 21.8 
0 = Individual doesn't have a Master's degree in 1986 

PHD86 | = Individual has a Ph.D. degree in 1986 5,962 a2 


0 = Individual doesn't have a Ph.D. degree in 1986 
















SVISOR = Individual has supervisory position 48,712} 26.0 
0 = Individual doesn't have supervisory position* 74.0 
PROF 1 = Occupational category is Professional 98,612} 52.7 
0 = Occupational category is not Professional 
ADMIN 1 = Occupational category is Administrative 65,554] 35. 
0 = Occupational category is not Administrative ia 
TECH** 1 = Occupational category is Technical 12,535 


0 = Occupational category is not Technical 
CLERK 1 = Occupational category is Clerical 10,036| 5.4 
| 0 = Occupational category is not Clerical 
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Table 4.6. (cont.) 





0.2 


OTHERWC 1 = Occupational category is Other White Collar 432 
0 = Occupational category is not Other White Collar _ 











FLEET 1 = Functional area is Fleet _ 21,679 





0 = Functional area is not Fleet 




































INTEL 1 = Functional area is Intelligence 9,088 
0 = Functional area is not Intelligence 

MATERIAL 1 = Functional area is Material 101,310) 54.2 
0 = Functional area is not Material 

TRAINING 1 = Functional area.is Training and Education 10,971 5.9 
0 = Functional area 1s not Training and Education 

MEDICAL 1 = Functional area is Medical 5,186 2.8 










0 = Functional area is not Medical 

HEADQRT 1 = Functional area is Department Headquarters 4,639 2.5 
a ne ee 
1 = Functional area is Administrative Activities 34,796 ot 
ea 
FEDYEAR Federal Service in years | 187,049). 12.1 


*Mean value of average performance ratings for all employees (4.0). 
**Base case variable. 











0=F unctional area is not Administrative Activities 
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Vz MULTIVARIATE ANALYSIS AND RESULTS, 


A 


_ This chapter presents the results of the multivariate analysis of the four different 
setianninee aa (salary, promotion, retention, and performance eae ih ete 
described above in Chapter IV. Each model is discussed separately in terms of its overall 
significance, the significance of its explanatory variables, the partial effects for the 


variables in the logit models, and goodness-of-fit measures. 


A. RESULTS OF SALARY MODEL 


Ordinary least squares (OLS) techniques were used to estimate the salary model 


that was specified in the following form; 
In(Y) = Bo + BX +e | 


as explained in detail in Chapter IV. Before presenting the results we think it is useful to 
give some information about the interpretation of the coefficients (parameter estimates). 
In this kind of model, the slope coefficients measure the constant proportional or relative 


change in Y fora given absolute change in the value of X (independent variables), that is, 
8 = Relative change in regressand / Absolute change in regressor 


This means that if we multiply the relative change in Y by 100, it gives the percentage 
change, or the growth rate, of Y for an absolute change in X, the regressor [Ref. 21]. This 
explanation about the interpretation of parameter estimates will be useful in 


understanding the results of this model in the following sections. The full regression 
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results are presented in Table 5.1. Recall from Chapter IV that for the salary model, we 
ran a two step model, the first without grade controls, and the second step including grade 


level as a control variable. Table 5.1 gives the results of both steps. 


1. Goodness of Fit 


_ Ina linear regression model, the coefficient of determination (R’) is a summary 
measure that tells us how well the sample regression line fits the data. It is the most 
commonly used measure of the goodness-of-fit of a regression model. Simply put, R? 
measures the proportion of the total variation in Y explained by the variation in the - 
explanatory variables. [Ref..21] Table 5.1 presents the results from estimating the salary 


model. In the first step of our salary model, R? is equal to 0.7653, which means 76.53 


percent of the variation in the log of annual salary is explained by. the variation in the 


explanatory variables included in the model. In the second step, R? is equal to 0.9539. 


Other measures of goodness-of-fit are overall significance of the model and the 
significance of individual coefficients. For our model we have an F value of 25,963 and a 
Prob>F value of 0.0001, which means we reject the null hypothesis that all the 
coefficients in the model are equal to zero. In other words, the model has some 
explanatory power. All the independent acables except OTHERACE, are statistically 
significant at 0.01 level. We decide this by looking at Prob > T values in the SAS output. 
As long as the significance level is greater than Prob > T value, we reject the null 


hypothesis that an individual coefficient is equal to zero. 
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2. Model Results 


Almost all of the explanatory variables in Table 5.1 have the expected signs, that 
is, they ‘have the expected positive or negative impacts on the dependent variable. The 
coefficients of MA. MS86, PHD86, METROPS6, FEDYEAR, PRIEXP, and SVISOR are 
all positive as expected. The species of FEMALE, BLACK, HISPANIC. 
VETERAN, CLERK, and OTHERWC are all negative as expected. These results are 
consistent with past studies. While we would have expected OTHERACE to be negative, 
it is positive, but not significant. This may be because this category comprises only 5.2 


percent of the sample. 


Other interesting findings from the model are that women earn 10.72 percent less 
than men, everything else held constant. There are also differences in minority salaries as 
Blacks earn 6.41 percent fess than Whites, while Hispanics earn 1.94 percent less. A | 
person with one more year of federal service experience earns 3.73 percent more. On the 
other hand, the effect of prior experience is nearly zero; an individual with one more year 
of prior labor market experience earns only a 0.1 percent higher annual federal salary. 
Individuals in "professional" and "administrative" jobs have higher annual salaries while 
individuals in "clerical" and "other white collar" jobs have lower annual salaries than 
individuals in "technical" jobs. Individuals in supervisor positions have 18.48 percent 
higher annual salaries. A person _ works in the South Atlantic census region earns 
6.03 percent higher annual salary than a worker in the Pacific census region (Column 1 


in Table 5.1). 
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Both of the education variables have positive effects on salary and they are 
significant a the 0.01 level. Master's degree holders earn 4:99 percent — date 
Bachelor's degree holders. This positive effect on annual salary is much higher for Ph.D. 
holders at 16.26 percent. These findings are consistent with the basic assumption of 
human capital theory that individuals with higher educational attainment earn more. 
However, one should be careful about the interpretation of coefficients. If we consider 
_ that Master's degree and Ph.D. degree holders begin their jobs in higher grade levels and 
there is a very high correlation between grade levels and annual salary (0.9017), then the 
effects of educational attainment may be overstated in the model. Tables 5.2 and 5.3 
display the distribution of educational attainment by occupational category and grade 
level, respectively. Table 5.2 shows that M.A. holders are more likely to be classified in 
the "professiona 3 occupational classification. Also, the modal entry grade for M.A. 
holders is GS-9, whereas for B.A.'s it is GS-7. To be able to see the effect of eincational ; 
attainment more accurately we controlled for grade levels in the second step by 
introducing GRADE86 variable into the model in Column 3 of Table 5.1. Controlling for 


grade level gives us within-grade earnings differentials. 


In the second model, all the variables except SFEDYEAR and OTHERWC are 
Significant at the 0.01 level. Having an M.A. again has a positive effect on annual salary 
but its magnitude is very a to zero (0.003). Master's degree =e earn only a 03 
percent higher annual salary when grade level is controlled. Thus, controlling for current 
grade level reduces the impact of M.A. by 94 percent. In this model Ph.D. degree holders 


earn 4.04 percent higher annual salary compared to Bachelor's degree holders. 
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Controlling for grade level reduces the impact of a doctorate by 75 percent. In other 
words, most of the effect of the educational attainment variables is associated with 
differences in grade levels. Column 3 of Table 5.1 reveals that the effect of almost all of 
the variables in the model fall after GRADE86 is introduced. The effect of SVISOR, for 


example, decreases from 18.48 percent to only 3.96 percent. 
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Table 5.1. Parameter Estimates and Standard Errors of Semi-log Salary Model for 


all Federal Workers, 1986 - 


Parameter Parameter |Standard 
Estimate Error Estimate Error 
0.0024 0.001 
0.0011 0.000 
0.000 
0.007 
‘|____0.0072[ 0.0019] 0.00997| 0.000 
0.000 
0.000 


01007 
0.000 

























0.000 
















| 0.0001 
PRIEXP | __0.0009| 0.0002} 0.001 0.0007 
NEWENG | 0.03607] __0.0022| _0.0045%| 0.0070 
WESTNC | __-0.014a"| 0.0021] _-0.0785%| 0.0009] 
0.0072| 0.0021] _-0.0050"| 0.0009 
PROF | 0.36387] _0.0017| __0.0576"| 0.0008 
ADMIN | __ 0.2204] 0.0017] _-0.0066"| 0.0008 
{CLERK |__-0.2350%|_0.0024_0.0337"|__ 0.0077] 
[NI | _ 0.1083 0.0003; 








OW 







a 1083 
OTE OSS - 

25,953 ‘| 158,467 
119,070] [| 119,070} a 


*Significant at 0.01 level. 
¥*N.I. = not included 
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Table 5.2. Percentage Distribution of Educational Attainment by Occupational 


Category 
OCCUPATIONAL | 
CATEGORY 










[oes INVENTORY | ____NEWHIRES | 
BAIBS. MAIMS. [PhD |BAJBS. [MAIMS. [PhD | 
; 


Technical [758i 338063] 802] 7.22! 0.00 
644] 187] 05a] 1406| 701] 0.52 


Clerical | __ 6.44 
OtherWhite Collar 030] 0.12] 0.07] ___ Oaal___ 0.72] 0.00 
TOTAL” | too] foo] 700] fo) foo] ___ 100 


*Individual percentages may not add up to 100 because of rounding. 








Table 5.3. Percentage Distribution of Educational Attainment by Grade Levels 











GRADE | ___1986INVENTORY 
LEVELS BABS. [MAIMS. [Ph.D |BAJBS. [MAIMS. [PhD __| 










[oor] 000 00g] 0.08] 0.00] ~—0.00 
—0.05| _0.02[_ 0.00] 0.430.009} 0.00 
tos} 0.29] ___0.02[ 5.88] 2. 46| 0.00 
2:36] 080] otal 65i] Bat _—C0.00 
628] T59[ 0.36] 20.84] B35] ___—«*-03 
tat] 0.38[_0.t8[ 0.73] 052] 0.00 
048} 021| _0.00| 044] 0.93, 0.00 
0.46] 0.39[ 0.08] 0.25] 0.52] 0.00 





25. 
13.55] 20.55, _23.89| 055] 2.37} 10.82 

q4___228 
2.07} 6.06|__ 157 
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*Individual percentages may not add up to 100 because of rounding. 


We also ran the same model for a sample of new hires only. Table 5.4 displays 


estimates from this model.: All the variables except HISPANIC, OTHERACE, 
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METROP86, MIDATLAN, WESTSC, and MOUNTAIN are significant at the 0.01 level. 
OTHERACE is significant at the 0.05 level. For this model R? is 0.5775, and Prob > F 
value is 0.0001, which that means we reject the null hypothesis that all the parameter 


estimates are equal to zero. 


All the variables except HISPANIC, VETERAN, and MOUNTAIN have the 
same signs as in the inventory model. Veterans have an advantage at the beginning of 
their employment. They earn 5.99 percent higher annual salaries compared to non- 


veterans, all other things held constant. 


Educational attainment variables again have positive signs. And their effects are 
greater than they were in the cross-sectional model of all workers in Table 5.1. Master's 
degree holders earn 8.98 percent higher annual entry level salaries while Ph.D.'s earn 
28.22 percent more. For the full sample in Table 5.1 these effects were 4.99 pacent and = 


16.27 percent for M.A.'s and Ph.D.'s, respectively. 


These results are consistent with the findings of Dunson (1985). He also found 
that M.A. and Ph.D. degree holders generally earned more than ro with a B.A. degree 
because they were in grades with higher mean earnings. He stated that only 26 percent of — 
the total earnings differentials between those with doctorates and those with B.A. degrees 
occurred within-grade in the Army sample. For the same sample, only 20 percent of the 


earnings differential occurred within-grade when M.A.'s were compared to B.A.'s. 
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Table 5.4 Parameter Estimates and Standard Errors of Semi-log 1986 Starting 
} Salary Model for New Hires - 


Variables Estimate. |Error 
INTERCEPT — 9. | —-9.5839* 0. pene 
















eee 





NEWENG | 0.0654"| 0.0736 
| 
PROF | 0.3878 0.0004 
ADMIN] 0.1014"| "0.0100 


F VALUE 43.5771 os 


SAMPLE SIZE 7,495| 


*Significant at 0.01 level. 
**Significant at 0.05 level. 
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_B. RESULTS OF PROMOTION MODEL 


In the construction of the promotion model in Chapter 4, we included only federal 
| employees serving in the DoD in 1986 and looked at their promotion histories between 
1986 and 1992. The purpose of choosing a 6-year seiica was to allow greater variation in 
the oroueion outcomes over time and to keep the number of observations high for better 
Statistical reliability. A binary dependent variable PROMOTE for this model a created 
based on individuals who were promoted at least once iii September 1986 and 
September 1992. The data set identified "date of last promotion" for each federal 
employee, which is the data element used to construct the dependent variable. If the 
individual's date of last promotion as of 1992 data set fell between 1986 and 1992, the 


dependent variable PROMOTE took a value of 1, otherwise it took the value of 0. 


Four aaiiaiiais of the basic promotion model are ee in this section. In . 
_ the first specification, we run the model without controls for grade level and performance 
rating. In the second suiibeiiieas we introduce grade level controls. Following that, 
only controls for the individual's performance rating are added to the model. In the final 
specification, we run the model including the controls for both grade level and 


performance rating. 


For the promotion model, maximum likelihood logit techniques were used to 
estimate the probability of being promoted for a particular individual based on the 


following equation; 


Prob(Promote)=Bo+BX+¢ 


78 

















The interpretation of coefficients from logit models is not as straightforward as in OLS 


model. The basic logit equation can be written as: 4 
| L=ln (P/1-P)=BotBXte. 


wie L is “logit,” and (P; / 1-P;j) is the odds ratio in favor of being promoted. The 
interpretation of B, the slope, is the change in Z for a unit change in X; that is, it tells how | 
the log-odds in favor of being promoted change as, let’s say, years of federal service 
changes by ens year. The constant (intercept) Bg is the value of log-odds in favor of being 
promoted if years of federal service is zero. Like most interpretations of intercepts, this 
interpretation may not have any useful meaning. [Ref. 21] Finally, the probability of 
being promoted is calculated using the following equation, eich is derived from the 


logit equation above and known as cumulative logistic distribution function: 
PHV/1+e 878 


In the following sections, the measures of goodness-of-fit and the results of the 


promotion model will be discussed. 


1. Goodness of Fit 


Before interpreting the results, the “goodness of fit” of the model is examined. 
There are three measures of goodness-of-fit ina mai ciel 1) The likelihood value and 
its p-value; 2) The statistical significance of 28 of the explanatory variables in the 
model; and 3) The classification table. The first determinant of goodness of fit in a logit 


model is the -2 LOG L value. This value is distributed Chi-square, and tests the 
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hypothesis that all coefficients are no different from zero. The —2 Log.L value for the 
promotion model is 157,710 (p=.0001). Thus, at least one-of the coefficients 1S 


significantly different from zero. In other words, the model has some explanatory power. 


In the inventory model, for the first stage, we have 16 of the 19 variables are 
significant at the 0.01 level or better. When we introduced controls for both grade level 
and individual’s performance 15 out of 21 explanatory variables were statistically 


significant. 


As the third measure of a model’s fit, we would like to maximize the number of 
correctly predicted events and non-events in the model. The term “event” in the 
promotion model can be defined as an observation that is predicted to be promoted when 
the person actually gets promoted. And, similarly, a “non-event” is an observation that is 
predicted as not ame promoted who does not actually: get promoted. The classification | 
tables of the promotion models provide us with almost 65-70 percent correctly predicted 
events and non-events at cut-off points of 0.5 and 0.56. Since we have high percentages 
of correctly predicted events and non-events along with the significant Chi-square value 
and the high number of statistically significant variables we conclude that the goodness- 


of-fit of the promotion models is acceptable. 


2s: Model Results 


In the first specification of the promotion model, we did not control for grade 
level in order to focus on the effects of individual characteristics on promotion 


probability. Table 5.5 provides a list of the explanatory variables along with parameter 
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estimates, standard errors, ‘al partial effects for the models with and without grade 
controls. The results in column 1 of Table 5.5 shows that all the independent variables 
except HISPANIC, CLERK, and FLEET are Statistically significant at the 0.01 level.. 
However, five of the pee variables -- BLACK, HISPANIC, VETERAN, 
MA- MS86, and PHD86 -- have different signs from laid were expected. We expected 
that Blacks, and Hispanics would be less likely to be promoted than Whites, and veterans 
would be less likely to be promoted than non-veterans. Furthermore, we assumed that 
higher educational ‘attainment should lead to higher probability of promotion. The 
MA. MS86 and PHD86 variables have negative signs, which means that Master’s degree 
and PhD. holders are less likely to get promoted than Bachelor's degree holders. Except 
for these Ave all the other variables have expected signs as hypothesized in Chapter IV. 
The FEMALE variable has a positive aan while OTHERACE, FEDYEAR, and SVISOR 


have negative signs. 


-_ In the promotion model, the notional peeon is specified as a white male, non- 
veteran, non-supervisor, with a Bachelor’s degree, who has 11.5 years of federal service 
and occupies a technical job in an administrative area. An individual with the 
_ characteristics of the notional person has a predicted promotion probability of .664. The 
partial (marginal) effects displayed in Table 5.5 are computed based on this notional 
person by dianeing each variable one unit one at a time. : All the other things constant, 
won are 6.35 percentage points more likely to be promoted, Blacks are 2.2 percentage 
points more likely to be promoted, and those from other racial categories (except 


Hispanics) are 7.11 percentage points less. likely to be promoted. Veterans appear to be 
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1.01 percentage points more likely to be promoted than non-veterans. Supervisors are 7.8 
percentage points less likely to be promoted compared to non-supervisors. FEDYEAR is 
estimated as negatively correlated with promotion probability. One additional year of 


federal service decreases the promotion probability by 1.91 percentage points. | 


Table 35.5. Logit Estimates, Standard Errors and Partial Effects of Promotion 
Model* 
(without control for individual’s performance rating level) 


(1) Without Grade Control (2) With Grade Control 
Parameter |Standard (Partial |Parameter jStandard (Partial 
Estimate Error Effects |Estimate [Error Effects 

























NTERCEPT 
EMALE 
LACK 


© 
~~I} OO 





















HISPANIC || __0.0366/ 0.0352] 0.0087] -0.0836"| 0.0364 -0.0208 
-0.0590 
“0.0191 
ADMIN 
0.0247] -0.0733 
0.0304] -0.0069 
p2LOGL__| 157,710} | 151,843) S 
wks SS & : 


*Significant at 0.01 level. 
**Significant at 0.05 level. 
“Dependent variable = PROMOTE: (0) Not promoted by 1992, (1) Promoted by 1992. 
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Having a Master’s degree or Doctorate is negatively correlated with promotion. 
Master’s degree holders have a 1.65 percentage point lower promotion probability, and 
Ph.D. holders have a 5. 95 porceninee point lower promotion probally. These results 
| may not be surprising if we recall that Master’s degree ne Ph.D. holders occupy higher 
grade levels and promotion opportunities tend to be less numerous at the higher grades. 
Thus, Master’s degree or Ph.D. holders may have ee of being promoted than 
Bachelor’s degree holders who are hired at lower grade levels. Therefore, we introduced 
a control for the grade level in 1986 into the model in order to investigate widinepals 


effects of the right hand side variables on the promotion probability. 


In the promotion model with a control for the grade in 1986, there are only three 
independent variables out of 20 that are not significant: BLACK, OTHERWC, and 
_ HEADQRT. HISPANIC and INTEL are statistically significant at the 0.05 feted: while 
all other 15 independent variables are significant at the 0.01 level or better. Differing | 
from the model without grade control, all explanatory variables have expected signs in 
accordance with the hypotheses in Chapter IV. All minority variables have negative 
signs. That is, Blacks, Hispanics, and other minority groups are 1.07, 2.08, and.9.43 
percentage points, respectively, less likely to be promoted than Whites. The effect of 
| educational attainment seems to favor promotion when we control for the grade in 1986. 
Both a Master’s degree and a Ph.D. have a significant and positive effect on promotion. 
A Master’s degree holder is estimated to have 2.06 percentage points higher promotion 
probability, and an individual with Ph.D. is 3.23 percentage points more likely to be 


promoted. 
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For the third and fourth specifications of the promotion model, we re-estimated 
the previous two models (with/without grade control) but included controls for each 


raat performance ratings during the 1986-1992 period. If ao ratings 


- reflect true on-the-job pertonnance they should be a key element sigineaishing between 


those who do and those who do not get promoted. Thus, an individual’s in-house 
perceived job performance should be controlled in the model. Table 5.6 displays the 
results for the models that include control for an employee’s performance rating level. 
Introducing RATLEV causes either small increases or decreases in the partial effects of 
the other explanatory variables when we do not control for grade level. All the variables 
have the same signs as they do in the first specification of the promotion model. The 
signs of MA_MS86 and PHD86 are negative again. The results suggest that a Master’s 
degree holder is 1.86 percentage ae less likely to be. ous and a Ph.D. holder is 


6.44 percentane point less likely to be pronisted when we do not control for grade level. 


In the final specification, we control for both performance rating level and grade 
level. Introducing both controls decreases the partial (marginal) effects in general. The 
signs of all the variables except that of BLACK remain unchanged from the second 
specification of promotion model in Table 5.5. BLACK is not found to be Statistically 
significant along with HISPANIC, OTHERWC, and INTEL. All the remaining variables 
are aienincanl at the 0.01 level. MA_MS86 and PHD86 have positive and slightly 
smaller partial effects than they do in the second specification in Table 5.5. The results 
Suggest that an Master’s degree increases promotion probability by 1.92 percentage 


points, which is 0.14 percentage point smaller than the effect in the specification in Table 
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5.5 when we do not control for performance rating level. Likewise, a Ph.D. increases 
promotion by 2.9 percentage points, which is 0.33 percentage point less than the effect in 
the specification controlling for 1986 grade level but not controlling for performance 


‘rating level in Table 5.5. 


Table 5.6. Logit Estimates, Standard Errors and Partial Effects of Promotion 
: | Model” 
(with control for individual’s performance rating level) 


(3) Without Grade Control _ (4) With Grade Control | 
Parameter |Standard /Partial {Parameter |Standard /Partial |. 
Estimate /jError Effects |Estimate /Error Effects 


1.0021] 0.0426 = ] 3.4914] 0.056922 
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“2LOGL : 


AMPLE SIZE 128,069} 


_ *Significant at 0.01 level. 
**Significant at 0.05 level. | 
*Dependent variable = PROMOTE: (0) Not promoted by 1992, (1) Promoted by 1992. 





HISPANIC | __0.0587[ 0.0353] 0.0128 _-0.0501] 0.0363] -0.0147 
0.0348] -0.0644] 0.11607] _0.0352[ 0.0290) 
0.0385] _0.2743"| 0.0084] 0.0685 
PROF | _-0.3354*| 0.0272) -0.0776| 0.6078" 0.0315] 0.1495 
ADMIN | _-0.2973*| 0.0273] -0.0578| 0.5305 0.0308] 0.1311 
OTHERWC | _1.0560"| 0.1665] 0.1822] -0.0048| 0.1719] -0.0072 
0.0242| C0714] -0.3757"| 0.0249] -0.0915 
INTEL | _-0.0714"| 0.0306] -0.0159] _0.0207| 0.0313] 0.0051 
0.0428| -0.1963] _-1.0487"| 0.0444) -0.2332 
-2L0GL 
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In general, the effect of educational level on promotion probability is found to be 
statistically Significant in all four specifications shown in Tables 5.5 and 5.6. The 
variables for educational attainment get negative signs when we do not control for each ' 
‘individual’s wiede level in 1986. This seit asi reasonable when we think that higher - 
degree holders occupy positions at higher grade levels and usually these positions have 
less chance of later promotion due to there being fewer openings at higher grades. When 
we control for grade level to see the within-grade effects of educational level on — 
promotion the signs of the education are positive as we expected. Introducing control for 
performance rating level in the later stages makes no change in the signs but lowers the 


partial effects slightly. 


C. RESULTS OF RETENTION MODEL 


In Chapter IV, we described the retention caodel based on stay-leave decisions for — 
the 6-year period between 1986 and 1992. An individual either remains a federal worker 
during this period or he/she leaves. Becaise of the binary nature of the dependent 
variable the logit technique was used. If an individual is still a federal worker in 1992, the 
independent variable RETENT92 takes the value of 1, otherwise it takes the value of 0. 
The parameter estimate in the logit model measures the change in L [In(Prob(stay)/ 1- 
Prob(stay))] for a unit. change ina given jndepsndent arbi That is, a slope coefficient 
(parameter estimate) in this retention model tells how the log-odds in favor of staying 
change as eis independent variable changes by a unit. In the following sections, we will 


' explain goodness-of-fit measures for the model and estimates of this model for both the 
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full 1986 cross-sectional sample and the new hires sample. The logit model estimates for 


both the inventory sample and for new hires in 1986 are presented-in Table 5.7. 


1. Goodness of Fit 


A general goodness-of-fit measure for logit model is the -2 LOG LIKELIHOOD 
statistic. This statistic has a chi-square distribution under the null aypothedis that - all 
regression coefficients in the model are zero. The -2 LOG L values for the inventory and 
"new hires" samples are 107,689 and 6243, respectively. We test this hypothesis by 

looking at the p-value. For both samples we have p-values of 0.0001, which means as 
long as the significance level is greater than this value, we reject the null. When the null 
hypothesis is rejected, it can be concluded that the regression model has some 


explanatory. power. 


As a second goodness-of-fit measure, we can look at the significance of the 
individual variables. We decide whether a variable is significant by issue at the 
Pr>Chi-Square value. If the significance level is greater than this value then the variable 
is Statistically significant. For the 1986 inventory, 15 out of 16 ecolaiaion variables are 
significant at the 0.01 level. For "new hires" sample 10 out of 15 explanatory variables 
are significant at the 0.01 level. 

Another measure of goodness-of-fit is the si sacation table. The ability of a 
retention model to classify stayers and leavers accurately provides some indication as to 


the usefulness of the model. "Sensitivity" is the ratio of the number of stayers correctly 


predicted as. stayers, while "specificity" is the ratio of the number of leavers correctly 
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predicted as leavers by the model. We want these two to be as high as possible. Actual 
retention rate (stayers/total sample) for the 1986 inventory is 0.79 (88936/112953). This 
| gives us an idea about the cutoff point, Predicted probabilities below this point are 
classified as leavers and those coors it are classified as stayers. At this point our node! 


correctly predicts 60.7 percent of the stayers, and 65.3 percent of the leavers. 


2. Model Results 


All the independent variables in the first column of Table 5.7 except HISPANIC 
are significant at the 0.01 level. The independent variables FEMALE, VETERAN, | 
AGES86, MA_MS86, PHD86, FLEET, TRAINING, MEDICAL, and HEADQRT all have 
negative signs. The effect of age on retention is not consistent with the assumption that 
older workers have less job mobility than younger workers. Note, however, the definition - 
of paces used here includes people who leave the DoD, but remain in federal service 
in a non-DoD agency. Although we excluded individuals with a federal service greater 
than 14 years to avoid the saaiien effect of retirement on retention, some individuals in 
our 1986 inventory sample might still gain their retirement eligibility Scie this period. 
Negative signs of educational attainment variables can be explained by higher job 
opportunities in the labor market. The variables BLACK, HISPANIC, OTHERACE, 
FEDYEAR, AVERAGE, INTEL, and MATERIAL all have positive signs. The positive 
signs of ethnicity and race variables can be explained by lower job opportunities in the 
labor market. Firm-specific experience, FEDYEAR, is also consistent with past studies. 


As one's years of federal service increases, it means an individual is accumulating larger 
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amounts of firm-specific human capital. Average performance rating during this period, 
AVERAGE, also has a positive effect on retention, which means better performers have a 


higher probability of staying in DoD. This is consistent with our expectation. 


To ssammien on the relative effects of individual variables we have to calculate 
partial (marginal) effects. For this model, a person with base case characteristics (male, 
white, non-veteran, 36.05 years of age, B.A. holder, with an average performance rating 
of 3.96, with federal experience of 6.07 years, and working in a “technical” area) has a 
predicted retention probability of 0.7997. The model calculates exebabilities by 
increasing each variable by one siti The difference between base case probability and 
~ calculated probability for a variable’s one unit change gives us the partial effect of that 


variable. 


_ The retention model indicates that women are 9.12 percentage ve less likely to | 
stay when compared to nee Blacks and Hispanics are 3.18 and 0.72 percentage points, 
respectively, more likely to stay in DoD. Each additional year of age reduces the 
retention rate by 0.16 percentage points. A person with one more federal service year is 
0.81 percentage points more likely to stay. A person with a l-unit higher avérage 
performance rating (e.g. going from 4 to 5) during the period between 1986 and 1992 is 
10.29 percentage points more likely to stay in DoD. MEDICAL has the greatest effect on 
retention among functional area; an individual in "medical" area is 16.73 percentage 


points less likely to stay in DoD when compared to a person in "technical" area. 


Both educational attainment variables are significant at the 0.01 level. M.A.'s are 


1.58 percentage points less likely to stay and Ph.D.'s are 2.61 percentage points less | 
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likely to stay. These negative effects may arise because of job opportunities for more 
educated workers in the labor market. - 


Table 5.7. Logit Estimates, Standard Errors and Partial Effects of Retention Model* 


1986 Inventory 1986 New Hires 


Parameter (Standard Partial Parameter {Standard Partial 
Estimate Error — Effect Estimate Error Effect 













; 



















































HISPANIC [0.0486] 0.0424] 0.0072 
0.0336[__0.0555| 0.6995 O.1124] 0.0852 
0.0692 
0.0379[-0-1673[-7.6098"| 0.1307, 0.3843 
HEADGRT 0.178 
we wa es 


*Significant at 0.01 level. 
**Significant at 0.05 level. | : 

“Dependent variable = RETENT92: (0) Individual is not in DoD in 1992, (1) Individual is still in DoD in 
1992. . ; 


For the new hires model, in Columns 4-6 of Table 3.7, all the shill except 
HISPANIC, VETERAN, PHD86, INTEL, and MATERIAL are significant at the 0.01 
level. In the new hires eau veterans and older workers have higher sada rates. 
This sample has a younger population than the hone sample and retirement might 


have little effect on the retention decision. This is consistent with the literature that older 
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people are less likely to change jobs and job mobility is greater for yqunger workers. 
Positive effect of salary in early years of employment of veterans-may affect their "stay" 
decision. _ 

Again snitadiiniate rating has a positive effect on scenic A person with a one- 
unit higher average colic rating is 15.25 more likely to stay. We can conclude that 
in early years of employment performance ratings have a greater effect on the stay/leave 
decision. | | 

For this sample, PHD86 variable is not statistically significant, while MA_MS86 
is significant at the 0.01 level. Both seal attainment variables have negative signs 
as in the 1986 inventory sample. An M.A. holder who is a new hire is 5.03 percentage 
points less likely to stay in DoD. This prediction is greater than that nahe inventory 
sample where the effect was 1.58 percentage points. This is also consistent oii the 
expectation aid ‘rieainite on this area that in early years of sicloyiien people are more 
likely to change jobs. During this time the job matching and job search processes induce 


job changes. 


D. RESULTS OF PERFORMANCE RATINGS MODEL 


In the performance ratings model developed in Chapter IV, we included in. the 
sample all federal employees serving in the DoD in FY1986 and created a dummy 
variable based on whether the average of their performance ratings between 1986 and 


1994 fell into the top half of the distribution for all ratings. We computed the average 
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performance ratings over an 8-year period (1986-1994). The dependent variable for this 
model, TOP, is based on an individual having an average performance rating which 
exceeds the mean value of all performance ratings (4.005) over the 1986-1994. That is, if 
the individual's computed eremiee periermane rating ee the mean value of all 
employees in the sample, then the dependent variable TOP took the value of 1; otherwise 


It took the value of 0. The basic performance-ratings model can be written as: 
Prob(Top)=B8, +BX+e 


Because the dependent variable is dichotomous, meaning that an event either occurs or 
does not occur, the logit technique was again used for estimations. The theoretical 
background of the logit model was explained in detail earlier in the thesis. Recall that the 
coefficients of the independent variables measure the change in L (logit) for a unit change 
in each lesion variable. That is, a coefficient in this performance ratings model tells _ 
how the log-odds of being in the top half of the distribution of all ratings changes as one 
of the explanatory variables changes by one unit. In the following sections, the goodness- 
of-fit and the models both for 1986 inventory and 1986 new hires will be discussed as 
well as the parameter estimates. The results for both the inventory sample a for new 


hires in 1986 are displayed in table 5.8. 


ae Goodness of Fit 


The three measures of goodness-of-fit for logit models indicate acceptable model 
performance for the performance-ratings models for both the 1986 inventory sample and 


the 1986 new hires sample. The log-likelihood values for the inventory and “new hires” 
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samples are 245,741 and 8,687, respectively. The p-values for both samples are 0.0001, 


which means that at least one of the coefficients in the model is significantly different 


from zero. In other words, the performance-ratings model has some explanatory power. 


In the inventory model, 18 of 19 variables are significant at the 0.01 level. For the 
“new hires” model, the number of significant variables is 13 out of 18; six are significant 


at the 0.01 level, two are significant at the 0.05 level, and five at the 0.10 level. 


The classification tables for the two models provide us with almost 60 percent 
' correctly predicted events and non-events at cut-off points of 0.4 and 0.48. The term 
“event” in the performance-ratings model is defined as an observation predicted to be in 
the top half of performance ratings when the person is seviily in the top half. And, 
similarly, the term “non-event” is an observation that is predicted to be in the bottom half 
when she/he is actually in the bottom half. Since we have high percentages of sone 
predicted events and non-events we snciwas that we have an acceptable goodness-of-fit 


for both models. 


2. ' Model Results 


In the 1986 inventory sample all the independent variables except CLERK are 
significant at the 0.01 level. All the variables have the signs hypothesized in Chapter IV. 
The explanatory variables BLACK, HISPANIC, OTHERACE, FEDYEAR, and 
OTHERWC are negatively correlated with being in the top half of the distribution of all 
a ee ratings. The rest of the variables -- FEMALE, VETERAN, MA MS86, 


PHD86, SVISOR and occupational group and functional area -- have positive signs. 


93 


In the performance-ratings model, the notional person is specified as a male, 
white, non-veteran, non-supervisor, with a bachelor's degree, who has 12.2 years of | 
federal service, and whose occupational group is technical and functional area is 
sinus ve An individual with the abil of the ssetlenial ened has a 
predicted probability of .267 to be in the top half category of the performance ratings 
distribution. The partial (marginal) effects displayed in Table 5.8 are computed based on 


this notional person by changing each variable one unit one at a time. 


Other things constant, the model estimates that women are 1.06 percentage point 
more likely to be in the top half of the performance ratings distribution. Blacks, 
Hispanics, and those categorized as other race have 8.3, 4.53, and 3.71 percentage points 
lower probabilities of being in the TOP half category. A veteran is 4.75 percentage points 
more likely to be rated in the TOP category. A supervisor, compared to a non-supervisor, 
1S 1 .)7 percentage points more likely to have an average of performance ratings that fall 
in the top half of the distribution. This huge differential may be perceived as evidence 
that the performance ratings of the individuals who have supervisory status are inflated. _ 
Holding everything else constant, one more year of federal service increases the 
probability of being in the top half by 0.21 percentage point. Of all occupational group 
variables, “administrative” has the largest positive marginal effect of 6.42 percentage 
points on the dependent variable (when compared 46 the technical occupational group). 
Furthermore, a person who works in any headquarters is 18.03 percentage point more 
likely to fall in top half of performance rating distribution than a person who works in 


any administrative functional area. 
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Both of the education variables, MA_MS86 and PHD86, are significant at the 


0.01 level. Master’s degree holders are 3.6 percentage points more likely to have average 
performance ratings in the top half, and Ph.D. holders are 6.27 percentage points more 
likely to be in the top half These resillis show that, as hypothesized in Chapter IV, 
educational widainnel indicates an individual’s adaptability or ability to cope with job 


demands and an important determinant of career success. 


In the “new hires” sample, FEDYEAR variable is excluded since all the 
observations are at the beginning of their federal career. For the “new hires” model, only 
9 out of 18 explanatory variables are significant. BLACK, SVISOR, ADMIN, INTEL, 
MATERIAL, and HEADQRT are significant at the 0.01 level. The MA_MS86 variable is 
insignificant while PHD variable is significant at the 0.05 level. Al the explanatory 
variables have expected signs except FEMALE, Also the VETERAN variable has the 
opposite sign as in the inventory model. The veterans’ advantage in initial placement may 
put them into OPE for which they are not fully qualified, thus their average performance 
ratings are likely to be lower than those of non-veterans in the early stages of their 


Careers. 


As shown in Table 5.8, the eis suggest that, among newly hired employees, 
women are 2.14 percentage points less likely to be in the top half of all performance 
ratings. Likewise, ene are 441 sdemiiag points less likely to be in the TOP 
category. For this model, MA_MS86 variable is not statistically significant, and PHD86 
is significant at the 0.05 level. Both of the saneaana variables have positive signs as in 


the 1986 inventory model. A new hire with an M.A. is 3.42 percentage points more likely 
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to be in top half of all performance ratings distribution, while a Ph.D. holder is 8.58 


percentage points more likely to be in the top half. + 


Table 5.8. Logit Estimates, Standard Errors and Partial Effects of Performance- 
‘Ratings Model’ a : 


1986 Inventory 1986 New Hires 


Parameter |Standard |Partial [Parameter (Standard |Partial 
Estimate Error Effects {Estimate Error 


0.0188 
-0.06 
“0.0717 
0.0475 
0.036 0.034 
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VI. CONCLUSIONS AND RECOMMENDATIONS 


A. SUMMARY 


In this thesis, we examined the effects of graduate education on the job 





performance of ae employees in the Department of Defense (DoD). The research 
required us to review the nature of the federal civilian personnel systems especially the 
areas of pay, promotion, and performance appraisal. Federal employees are subject to 
periodic appraisals of their performance nade Performance Management Regulations 
issued by the office of Personnel Management (OPM). The eile systems are based 
on objective, job-related criteria and have performance standards for each element of the 
job on which an eaployee iS to be evaluated. The DoD civilian employee appraisal 
system has five levels of performance rating with level 1 as the lowest and level 5 as the 


highest. 


The DoD promotion system is based on merit. Competition among employees is: | 


generally required. To be eligible for promotion employees generally must meet the 





position’s qualifications, and, if applicable, time-in-grade requirements, the time-after- 
competitive-appointment restriction, and requirements for “fully successful” 
performance. 

There are various pay systems used by the federal government that are also 
applicable to the DoD civilian workforce. Most of the DoD civilian employees are paid 


under one of the two main government pay systems: (1) the “general schedule” (GS) pay 


97 





system, which sets specific salary levels for the white-collar civilian workers; or (2) the 
wage sien: which pertains the DoD’s craft and trade (blue-collar) workers. Both GS 
and wage system (WS) rates are established and adjusted annually pursuant to law and 
implementing sepaletinas In addition, there are a number of other pay ee ‘oni 
salary systems that govern the amount of compensation paid to certain unique groups of 


government employees. 


The effects of post-secondary education on an individual's career have been 
studied extensively. In particular, a few researchers have investigated the return on 
Local for pursuing graduate education. For example, David A.Wise (1975) 
conducted two studies in 1975 and concluded that graduate education provided a positive 
increase on salary for the employees of a single firm. Studies that have observed this 
effect have attributed the higher earnings to increased job performance. On the other 
hand, James Medoff and Katharine Abraham (1980) found a positive association between 
experience and relative earnings within grade levels in three U.S. manufacturing 
corporations. However, they found no association, or a negative association, between 
experience and rated performance (a proxy for productivity). They suggest that these 
findings provide evidence contrary to the implications of human capital theories that the 
higher earnings of more experienced workers in a firm reflect their on-the-job training, 
which makes them ete productive than their less experienced peers. Similarly, B. 
Dunson (1985) replicated one of the Medoff-Abraham tests to examine whether 
differences in earnings for a selected group of civilian middle managers and professionals 


in the DoD can be explained by the hypothesis that more experienced workers are more 
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productive workers. His results were similar to those of Medoff and Abraham. Finally, 
Mehay and Bowman (1999) examined the effect of graduate. education on the job 
performance of Navy officers. They used promotion as a performance measure and found - 
that nea with graduate degrees a bili likely to be cnaialud The effect — 
somewhat larger for those with degrees funded by the Naw: However, the effects of 


graduate degrees were smaller in models that adjusted for selection bias. 


The einai research question for this thesis was: "What 1s the effect of graduate 
education on the job performance of DoD civilian employees? That is, what is the payoff 
to employees and the DoD, from advanced education?" For the study, we adopted the 
approach of human capital theory that an individual’s productivity, and on-the-job 
performance, increases with additional education. To be able to answer this question 
different proxy measures for on-the-job performance -- salary level, promotion | 
probability, performance ratings, and retention -- were analyzed extensively in this thesis 


using multivariate data analysis techniques. 


The data used in this thesis were dean from Department of Defense Civilian 
Personnel Data Files, which were provided by Defense Manpower Data Center (DMDC). 
_ Two data files exist for DoD civilian personnel: (1) an inventory (current status) file, and 
(2) a transaction (dynamic) file. Both file types soniat similar data elements. For the 
purpose of this study, DMDC micnaed these two files ‘ite the one on which we based the 


four j ob-performance models. 


Ordinary least square (OLS) methods were used to estimate salary models and 


maximum likelihood logit techniques were used to estimate the binary promotion, 
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retention, and performance-ratings models. Salary, retention, and performance-ratings 
models were run for two separate samples:(1) 1986 inventory-that includes only the 
employees who were serving in DoD i in 1986, and (2) 1986 new hires that i ony 
: the enpisyees who were hired in 1986. ‘Each of the salary and Eromenon naodels was 
run twice; first with no controls for grade level, then with controls. Almost all the models 
mail in a substantial number of statistically significant variebiss and a high level of 
goodness-of-fit. Other than a few exceptions, most of the explanatory variables had 
expected signs. Along with educational sntnntent sex, race, veteran status, and 
experience (years of federal service and/or prior experience) were estimated to have 
substantial effects on the-job-performance. Table 6.1 summarizes the effects of having a 


Master’s degree on different performance measures. 


Table 6.1. The Effect of Master's Degree on Different Performance Measures* - 


Models [Specifications [1986 Inventory _|New Hires _ 

Say | 7 | —SC=~= SCC 

_— _ 080] 

tt] 

22.06 
— 






















Promotion*** 








86| WA 


ee 


Performance TT 3.60 _ 
Rating | = a | 


*Percentage effect on annual salary; Marginal effect (in percentage points) on the — 
probability of promotion, retention, or being in “Top” performance category. 

**(]1) without controlling for grade; (2) controlling for grade 

***(])without controlling for grade; (2) controlling for grade; (3) controlling "performance 
rating" without grade control; and (4) controlling for both "performance rating" and grade. 
N.A. = Not applicable 
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-B. CONCLUSIONS 


A 


The effect of having a Master’s degree on annual salary level was positive and 
| statistically significant. This positive effect was much smaller when "srade level" was 
nodes into the model in the anid stage. This — is not surprising if we consider 
that Master's degree holders enter the organization in positions at higher grade levels and 
the basic determinant of annual salary is grade level. When we ran the model for the 
“new hires" sample, we found that the effect of a Master's degree was higher at the 
beginning of employment in the DoD. Although the sale control lowered the effect, it 
was still significant. This positive effect of a Master's degree is consistent with past 


studies and with human capital investment theory. 


When promotion probability was considered as a performance measure, the effect 
of graduate education was found to be statistically significant in all four specifications of | 
he model. The control variable for Master's degree had a negative sign when we did not 
control for grade level. This result seems reasonable when we consider that individuals 
with higher educational attainment occupy positions at higher grade levels and people in 
these positions usually have fewer opportunities for promotion due to fewer openings at 
those levels in the hierarchical structure of the organization. When we controlled for 
snide level to see the within-grade effect of a Master's degree on promotion, the effect 
Was positive as | expected. Introducing controls for performance rating level in the later 
stages made no change in the direction of the effect but lowered the marginal effect of a 


Master's degree slightly. 


10] 





The effect of graduate education on retention (the probability of staying) was 
hegative and statistically significant. This negative effect was much higher when we ran 
the model for the "new hires" only sample. Both findings from this model are reasonable a 
di of greater job opportunities in the labor market for Master's degree holders 
compared to Bachelor's degree holders. Individuals invest in graduate education 
expecting higher returns in the future. So, they are more likely to search for better 


opportunities in the labor market especially in the early years of their employment. 


The last productivity measure was performance rating level. The effect of a 
Master's degree was found to be positive and statistically significant. This positive effect 
was almost the same in both the inventory and "new hires" samples. This finding 
confirms our assumption that individuals with higher educational attainment, in our case 


Master's degree holders, are better performers compared to Bachelor's degree holders. 


In summary, we conclude that Master's degree holders earn higher annual salaries 
and = more likely to promote. They are more productive — within the DoD. On 
the other hand, they are less likely to stay in the DoD when compared to Bachelor's 
degree holders. All these findings are consistent with basic human capital investment 
theory. But they contradict with the findings of Dunson (1985) and Medoff and Abraham 
(1980) that there is no relation between human capital investment and on-the-j ob 


performance. 
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C. RECOMMENDATIONS FOR FURTHER RESEARCH 


This thesis investigated the effects of graduate education on the job performance 
of DoD civilian employees. We found that graduate education has a positive effect on 


annual salary, promotion, and performance rating; a negative effect on retention. 


Until this thesis, no known attempt has been made to investigate the effect of 
graduate education on the job sialtabideas of federal civilian employees using the 
performance measures we have developed. Because this is the first research in this area, 
further research is strongly recommended. Specific points for further research are 


discussed in the following paragraphs. 


First of all, the Department of Defense Civilian Personnel Data File that we used 
for this study has some problems. Performance ratings and promotion information for 
some DoD agencies was not provided for some years. Also, there were some flaws in the 
"educational attainment" and "year of degree attained" data elements. These problems 
continued even after we received a revised data file from DMDC. We tried to fix these 
problems before we ran our multivariate models. We recommend these problems be 


corrected by the DMDC to help future researchers to obtain more accurate results. 


Secondly, we did not investigate whether there was a difference of the effect of 
graduate education among different DoD agencies. We recommend that the sample be 


separated by agency to see if the effect of graduate education differs across agencies. 


As a third recommendation, we encourage future Manpower System Analysis 


(MSA) Curriculum students to focus on specific functional or occupational areas. Our 
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study investigated a general omen without restriction to a specific occupational category 
or a specific functional area. We recommend focusing on a specific performance measure 
like promotion, as Mehay and Bowman (1999) did, to give more concrete results about a 
specific ti dcttinnillccinialibaii ikea ‘ies we developed four performance ee for 
our research: salary level, promotion, performance rating, and retention. Developing 
different performance measures, such as time elapsed between two cuanto 
promotions or salary differentials between two selected years, will give more insight ints 


the effect of a Master's degree on the job performance. 


As a last recommendation, we want to mention the possibility of selection bias. In 
our research we could not find any cnronnation about a fully funded graduate education 
program for civilian employees. For this reason, we did not have to analyze selection 
bias. However, if possible, information should be collected on when M.A. degrees wee 
completed by employees and on whether the employer or the emploves paid for the 


degree. 
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APPENDIX A. DEFENSE CIVILIAN PERSONNEL DATA FILE RECORD LAYOUT (AS OF JANUARY 1998) 
(Source: Defense Manpower Data Center) ; 
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APPENDIX B. DEFENSE CIVILIAN PERSONNEL DATA FILE LAYOUT (8609 THROUGH 9902) 
(DATA ELEMENTS USED IN THE THESIS) 


(Source: Defense Manpower Data Center) ’ 
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APPENDIX C. TABLES FOR "NEW HIRES" MODELS 


Table C.1. Variable Definitions and Descriptive Statistics for Salary Model 
(New Hires, N = 7,495) | 


Variable Description . - | | 


Log of annual salary for the year 1986 
a 


1 = Female : 2,832 37.8 
0 = Male 62.2 
1 = Black 764 10.2 
0 = Not Black in Tie 





Variable Name 


n (SALARY) 
ndependent Variables 
FEMALE 


BLACK 


HISPANIC. 1 = Hispanic 
0 = Not Hispanic 
1 = White | 5,744 76.6 


0 = Not White | 

}=OtherRace 718 

0 = Not Other Race | [oo 

VETERAN 1 = Veteran 518 6.9 
| 0 = Not Veteran 

BA_BS86 1 = Individual has a Bachelor's degree in 1986 

0 = Individual doesn't have a Bachelor's degree in 1986 

1 = Individual has a Master's degree in 1986 

0 = Individual doesn't have a Master's degree in 1986 


1 = Individual has a Ph.D. degree in 1986 
0 = Individual doesn't have a Ph.D. degree in 1986 


METROP86 1 = Metropolitan Area | 6,183 82.5 
|. | 0 = Not Metropolitan Area _ 
NEWENG 1 = Census Region is New England 289 3.9 
0 = Census Region is not New England | a 

MIDATLAN 1 = Census Region is Mid Atlantic | 
0 = Census Region is not Mid Atlantic 


EASTNC 1 = Census Region is East North Central 706 
0 = Census Region is not East North Central 


WESTNC 1 = Census Region is West North Central 313 4.2 
0 = Census Region is not West North Central 


OTHERACE 







MA MS86 








PHD86 















SOUTHAT 1 = Census Region is South Atlantic 62,351 31.4 
0 = Census Region is not South Atlantic | 

EASTSC 1 = Census Region is East South Central 330 44 
0 = Census Region is not East South Central -. 

WESTSC 1 = Census Region is West South Central 962 12.8 
0 = Census Region is not West South Central | 

MOUNTAIN 1 = Census Region is Mountain | 360 4.8 
0 = Census Region is not Mountain -,. 


=a Ss 

yon @ 
nl = 
ms . 
3 

-- 

< 

$9 

me 

< 

S 

: @ 


PACIFIC _ ffl = Census Region is Pacific 1,466 
- 0 = Census Region is not Pacific 
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Table C.1. (cont.) 












] = Individual has supervisory position ‘ 
0 = Individual doesn't have supervisory position 
1 = Occupational category is Professional 
0 = Occupational category is not Professional __ 
1 = Occupational category is Administrative. 
0 = Occupational category is not Administrative 
1 = Occupational category is Technical . 578 7.7 
p= OncpatinleaepoybantTeaaial || 
1 = Occupational category is Clerical 959 12.8 
0 = Occupational category is not Clerical - 


1 = Occupational category is Other White Collar 
0 = Occupational category is not Other White Collar 


Prior Experience in years | 7,495 , 


QPRIEXP Square of Prior Experience 7,495 135.04 


ALARY | Annual Salary for 1986 7,495} 20,680.83]: 
n(SALARY) Log of annual salary | 7,495 9.88 


* Base Case Variable 





211 2.8 
7,284 97.2 


4.251 56.7 


















1,647| 22.0 




















my | 0) Q wad Sy 
Ss Gl oa x 
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Table C.2. Variable Definitions and Descriptive Statistics for Promotion Model 
(New hires, N=3,695) 


| Variable Name | Variable Description 
Dependent Variable. = ee et . La ee 
1 = Promoted by 1992 a 1 3,267 | 884 |. 
0 = Not promoted by 1992 428 11.6 


PROMOT | 
Independent Variables 


FEMALE 1 = Female 1,256 34.0 
0 = Male* 2,439 66.0 


















BLACK 1 = Black 389 | 10.5 
0 = Not Black 
HISPANIC i = Hispanic ) 1 ia1.| 33 
0 = Not Hispanic 
WHITE* 1 = White T 2,769 | 74.9 
0 = Not White 
OTHERACE | = Other Race 416 | 113 
pe fpenmomeme 
VETERAN | = Veteran 3,378 | 914 
lo =Not Veteran* i 317 8.6 | 
BA BS86* | = Individual has a Bachelor's degree in 1986 3,102 | 84.0 | © 
0 = Individual doesn't have a Bachelor's degree in 1986 eee 






1 = Individual has a Master's degree in 1986 478 12.9 


0 = Individual doesn't have a Master's degree in 1986 


PHD86 1 = Individual has a PhD degree in 1986 115 3.1 
0 = Individual doesn't have a PhD degree in 1986 


1 =Rating level is 1 


MA_MS86_ 






2 =Rating level is 2 











3 =Rating level is 3 
4 =Rating level is 4 
5 =Rating level is 5 











8. 
= Individual has supervisory position 


9 
112, | 3.0 
Ce 0 = Individual doesn't have supervisory position* 
PROF - {1 = Occupational category is Professional | 2,190 | 59.3 
P-ompioal en sawPetint || 
1 = Occupational category is Administrative 


SVISOR 









0 = Occupational category is not Administrative 
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Table C.2. (cont.) 












1 = Occupational category is Technical 6.5 





0 = Occupational category is not Technical 





1 = Occupational category is Clerical 373 | 10.1 





0 = Occupational category is not Clerical 


1 = Occupational category is Other White Collar 0.4 
p=cscnnlemeysumonervniecone | | 
FLEET 1 = Functional area is Fleet 291 7.9 
0 = Functional area is not Fleet | 





OTHERWC 









INTEL 1 = Functional area is Intelligence 260 7.0 





0 = Functional area is not Intelligence 
MATERIAL 1 = Functional area is Material 1,807 










0 = Functional area is not Material 










TRAINING 1 = Functional area is Training and Education 
0 = Functional area is not Training and Education 


MEDICAL 1 = Functional area is Medical 120 3.2 






0 = Functional area is not Medical 


] = Functional area is Department Headquarters 71 
| 0 = Functional area is not Department Headquarters 


1 = Functional area is Administrative Activities 998 27.0 


Pc 
Ie 
5 
a) 
a . 


5 
2 
> 
Q 
rj 

# 








0 = Functional area is not Administrative Activities 


a 





* Base case variable 
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Table C.3. Variable Definitions and Descriptive Statistics for Retention Model 
(New Hires, N = 6,007) 


| ; Variable Description a | 
ee peecciemenmeneie! % 


oT 

o 

oi 5). 
ps) 

al & 

si ° 

a 2 

<i 5 

| @ 

pot] 

cs 

= | 

























ee | 
1 = Individual is still in DoD in 1992 4,236 70.5 
ee 0 = Individual is not in DoD in 1992 1,771 
rt 
FEMALE 1 = Female : 2,195 36.5 
rua foal en] as 
BLACK ] = Black 624 
PACE pene 
HISPANIC 1 = Hispanic 223 3.7 
WHITE 1 = White 4,550 75.7 
OTHERACE 1 = Other Race | 10.2 
PRACT feneonernee 
VETERAN ] = Veteran | 440 7.3 
BA_BS86 _ |/1 = Individual has a Bachelor's degree in 1986 5,057 84.2 
0 = Individual doesn't have a Bachelor's degree in 1986 © 
MA_MS86 1 = Individual has a Master's degree in 1986 778 13.0 
— 0 = Individual doesn't have a Master's degree in 1986 
1 = Individual has a Ph.D. degree in 1986 172 


0 = Individual doesn't have a Ph.D. degree in 1986 

FLEET - 1] = Functional area is Fleet 425 
0 = Functional area is not Fleet | 

INTEL 1 = Functional area is Intelligence 357 

0 = Functional area is not Intelligence : 

MATERIAL 1 = Functional area is Material 2,841 47. 

0 = Functional area is not Material 





\O — \O 


we 















TRAINING 1 = Functional area is Training and Education 277 4.6 
0 = Functional area is not Training and Education L 
MEDICAL ] = Functional area is Medical — 363 
0 = Functional area is not Medical . 
HEADQRT | 1 = Functional area is Department Headquarters 185 3.1 
0 = Functional area is not Department Headquarters 4 
ADMINACT 1 = Functional area is Administrative Activities 1,559 26.0 






0 = Functional-area is not Administrative Activities | 


AVERAGE Average performance ratings between 1986 and 1992 6,00 
AGE86 Age in 1986 6,00 
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Table C.4. Variable Definitions and Descriptive Statistics for oe ee Ratings 


Model (New hires, N=6,404) 
| 


Variable Description 
Dependent Variable . | } 












1 = Individual's average performance rating is greater than 
isample mean for all employees* 

0 = Individual's average performance rating is smaller than 
sample mean for all employees* 






| 


FEMALE 1 = Female 2,587 | 40.4 
BLACK 1 = Black 
femme 









HISPANIC 1 = Hispanic 249. | 3.9 
0 = Not Hispanic 
WHITE** 1 = White | | 4,832 | 75.5 


0 = Not White 


OTHERACE “IT = Other Race : 633 
0 = Not Other Race | 


VETERAN a 1 = Veteran | 5,926 92.5 
0 = Not Veteran** - : : 
BA_BS86** 1 = Individual has a Bachelor's degree in 1986 5,367 


MA_MS86 1 = Individual has a Master's degree in 1986 a 4 
0 = Individual! doesn't have a Master's degree in 1986 






0 = Individual doesn't have a Bachelor's degree in 1986 












PHD86 1 = Individual has a PhD degree in 1986 fe 
0 = Individual doesn't have a PhD degree in 1986 : 

SVISOR 1 = Individual has supervisory position 214 3.3 
0 = Individual doesn't have supervisory position* 

PROF 1 = Occupational category is Professional 3,605 | 56.3 






| 0 = Occupational category is not Professional 
ADMIN : l= Occupational category is Administrative | ) 1,386 | 21.6 
0 = Occupational category is not Administrative | eye 
TECH** 1 = Occupational category is Technical __ 567 
Paosopeempeynetns | | 
CLERK 1 = Occupational category is Clerical 805 12.6 
an 0 = Occupational category is not Clerical eye 
OTHERWC - 1 = Occupational category is Other White Collar 
| a | 0 = Occupational category is not Other White Collar aie 
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Table C.4. (cont.) 














FLEET 1 = Functional area is Fleet 789 12.3 
| a 0 = Functional area is not Fleet . SO os 
INTEL | = Functional area is Intelligence : 364 5.7 

re eee eee 


MATERIAL 1 = Functional area is Material | 2,789 43.6 














10 = Functional area is not Material 





292 | 4.6 










1 = Functional area is Training and Education 


| 0 = Functional area is not Training and Education 
MEDICAL 1 = Functional area is Medical _ 367 5.7 
pe focramomtomsonvetea || 
HEADQRT | _ f 1 = Functional area is Department Headquarters 3.0 
0=Pcl anion Dement || 
ADMINACT** 1 = Functional area is Administrative Activities 1,612 25.1 
| 0 = Functional area is not Administrative Activities eal ioe 
baie 








TRAINING 










N 
AGE86 Employee's age in 1986 6,404 


AVERAGE 6am 


*Mean value of average ee rating for all oe (3.7). 
**Base case variable. 
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